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Abstract 

We develop a theory for solving continuous time optimal stopping problems for non-linear expectations. Our 
motivation is to consider problems in which the stopper uses risk measures to evaluate future rewards. 
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1 Introduction 

We solve continuous time optimal stopping problems in which the reward is evaluated using non-linear expec- 
tations. Our purpose is to use criteria other than the expected value to evaluate the present value of future 
rewards. Such criteria include risk measures, which are not necessarily linear. Given a filtered probability space 
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(f2, J-", P, F = {J't}te[o.T]) satisfying the usual assumptions, we define a filtration-consistent non-linear expectation 

(F-expectation for short) with domain A as a collection of operators [-jj^f] : A t-^ Ai ^ A n {J-t)} ^^^^ j,-^ 
satisfying "Monotonicity" , "Ti me- Consiste ncy" , "Zero-one Law" and "Translation-Invariance" . This definition is 



similar to the one propose d in iPena |2004| . A notable example of an F-expectatio n is the so-called q- expectat ion, 
introduced by iPena |1997| . A fairly large class of con vex risk measures (s e e e.g. iFoUmer and Schiedl 120041 for 



Huetal 



2003) 



the definition o f risk measures) are ^-expectations (see Coquet et al. 2002 [. Pens 2004j . Ma and YaoT 2007| and 



We consider two optimal stopping problems. In the first one, the stopper aims to find an optimal stopping time 
when there are multiple priors and the Nature is in cooperation with the stopper; i.e., the stopper finds an optimal 
stopping time that attains 



Z(0)= sup £,[Yp + WplTo], 

(i,p)GXx5o,r 



(1.1) 



in which — {£i}i^x is a stable class of F-expectations, iSq.t is the set of stopping times that take value in [0,r]. 
The reward process y is a right-continuous F-adapted process and for any G Sq^t, belongs to A# = S 
A I ^ > c, a.s. for some c G M}, where A is the common domain of the elements in S". On the other hand, the 
model- dependent reward processes {H^}i^jq is a family of right-continuous adapted processes with Hq — that is 
consistent with We will express the solution of this problem in terms of the S-upper Snell envelope of Yj, 
the smallest RCLL F-adapted process dominating Y such that Z^'^ = {Z° -I- i/(}tg[o,T] is an £i-supermartingale 
for each i G I. 



The construction of the Snell envelope is not straightforward. First, for any i E I, the conditional expectation 
C G ^ and ly G Sq.t may not be well defined. However, we show that t — > admits a right-continuous 

modification t for any £, G A and that £i is itself an F-expectation on A* such that is well defined 

on A"^ for any u G Sq^t- In terms of £i we have that 



Z(0)= sup £,[Yp + H;\J^o]. 

ii.,p)eXxSa,T 



(1.2) 



Finding a RCLL modification requires the development of an upcrossing theorem. This theorem relies on the 
strict monotonicity of £i and other mild hypotheses, one of which is equivalent to having lower semi-continuity (i.e. 
Fatou's lemma). Thanks to the right continuity of i ^ f^CI-^tli we also have an optional sampling theorem for 
right-continuous fi-supermartingales. Another important tool in finding an optimal stopping time, the dominated 
convergence theorem is also developed under another mild assumption. 

The stability assumption we make on the family # is another essential ingredient in the construction of the Snell 
envelope. It guarantees that the class co is closed under pasting: for any i,j G X and v G 5o,r there exists a fc G I 
such that ~ £i [f^ [^iJ'i^vcr] |-^cr] I for any a G Sq^t- Under this assumption it can then be seen, for example, 



that the collection of random variables 



HI - W 



{i,p) G I X 5^,7^1 is directed upwards. When 



the co nstituents of S are linear expectations, the notion of stability of this collection is given bv lFollmer and Schied 



20041 Definition 6.44], who showed that pasting two probability measures equivalent to P at a stopping time one 



will result in another probability measure equivalent to P. Our result in Proposition 13. II shows that we have the 
same pasting property for F-expectations. As we shall see, the stability is a crucial assumption in showing that 
the Snell envelope is a supermartingale. This property of the Snell envelope is a generalization of time consistency. 



I.e., 



esssup£i[CI-^i'] = esssupfj 



esssup £i[^\Tcr] 



a.s., Vi^, cr G So,T with < cr, a.s. 



(1.3) 



DelbaenI 20061 . Theorem 12] showed in the linear expectations case that the time consistency (|1.3p is equivalent to 
the stability. 

When the reward t ^ Yt + HI is "(f-uniformly-left-continuous" and each non-linear expectation in co is convex, 
we can find an optimal stopping time f(0) for (jl.ip in terms of the Snell envelope. As a corollary we can solve the 
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problem 

sup £,[Yp + Hl\To], (1.4) 

p£5o,T 

when £i [■\J't\ has among other properties strict monotonicity, lower semi-continuity, dominated convergence theorem 
and the upcrossing lemma. Note that although, esssupfi['l-^t] has similar properties to £i[-\J-t] (and that might 

lead one to think that can actually be considered as a special case of (jl.4p ). the former does not satisfy strict 
monotonicity, the upcrossing lemma, and the dominated convergence theorem. One motivation for considering 
optimal stopping with multiple priors is to solve optimal stopping problems for "non-linear expectations" which do 
not satisfy these properties. 

We show that the collection of (/-expectations with uniformly Lipschitz generators satisfy the uniform left 
continuity assumption. Moreover, a ^-expectation satisfies all the assumptions we ask of each £i for the upcrossing 
theorem, Fatou's lemma and the dominated convergence theorem to hold; and pasting of ^-expectations results in 
another (/-expectation. As a result the case of g-expectations presents a non-conventional example in which we can 
determine an optimal stopping time for (jl.ip . In fact, in the (/-expectation example we can even find an optimal 
prior i* £ X, i.e., 

Z(0)=f,;4y7(o)+i?;(o)l-^o]. (1.5) 



In the second problem, the stopper tries to find a robust optimal stopping time that attains 

1/(0)= sup iiii E,[Yp+Hl\Fo\. (1.6) 

Under the uniform-right-continuity" assumption, we find an optimal stopping time in terms of the <S -lower Snell 
envelope. An immediate by-product is the following minimax theorem 

1/(0) = inf sup £,[rp+i/;|j-o]. (1.7) 



Our paper was inspired by Karatzas and Zamfirescu 2006 1 and Karatzas and Zamfirescu 2008j |. which devel- 
oped a martingale approach to solving (|l.ll) and (|1.6p . when £" is & class of linear expectations. In particular. 



Karatzas and Zamfirescu 



2006l | considered the controller- stopper problem 



sup sup 



h{s,X,Us)ds 



(1.8) 



where X{t) — x -\- f{s,X,Us)ds -\- a{s, X)dW^ . In this problem, the stability condition is automatically 
satisfied. Her e, q and h are assumed to be b ounded measurable functions. Our results on (/-expectation s extend 



the results of iKaratza s and ZamfirescJ |2006l| from bounded rewards to rewards satisfying linear growth. iDelbaenI 
iKaratzas and Zamfire scu [.2005,] also considered (jl.ip when the f^'s are linear expectations. The latter 



paper made a convexity assumption on the collection of equivalent probability measures instead of a stability 
assumption. On the othe r hand, t he discrete time versio n of the robust optimization problem was analyzed by 



Follmer and Schied 



200J|. Also see lCheridito et all |2006l Sections 5.2 and 5.3] 



The rest of the paper is organized as follows: In Section [TTT] we will introduce some notations that will be used 
throughout the paper. In Section[2l we define what we mean by an F-expectation £, propose some basic hypotheses 
on £ and discuss their implications such as Fatou's lemma, dominated convergence theorem and upcrossing lemma. 
We show that t — > ^i']-^*] admits a right-continuous modification which is also an F-expectation and satisfies 
Fatou's lemma and the dominated convergence theorem. This step is essential since i5[-]J^,y], v £ Sq^t may not be 
well defined. We also show that the optional sampling theorem holds. The results in Section [5] will be the backbone 
of our analysis in the later sections. 
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In Section [3] we introduce the stable class of F-expectations and review the properties of essential extremum. 
In Section 2] we solve (jl.2l) . and find an optimal stopping time in terms of the S -upper Snell envelope. On the 
other hand, in Section [5] we solve the robust optimization problem (jl.6l) in terms of the S -lower Snell envelope. 
In Section [6l we give some interpretations and remarks on our results in the previous sections. In Section [7] we 
consider the case when (S' is a certain collection of (7-expectations. We see that in this framework, our assumptions 
on each £i, the stability condition and the uniform left/right continuity conditions are naturally satisfied. We also 
de termine an optimal prior i* € I satisfying (jl.Sp . Moreover, we show how the controller and stopper problem 



of iKaratzas and Zamfirescul |2006l | fits into our g-expectations framework. This lets us extend their result from 
bounded rewards to rewards satisfying linear growth. In this section, we also solve optimal stopping problem for 
quadratic (^-expectations. The proofs of our results are presented in Section [H 

1.1 Notation 

Throughout this paper, we fix a finite time horizon T > and consider a complete probability space {rt,J-,P) 
equipped with a right continuous filtration F = {J't}te[o,T]: not necessarily Brownian one, such that J-q is generated 
by all P-null sets in T (in fact, J-q collects all measurable sets with probability or 1). Let iSo,r be the collection 
of all F-stopping times v such that < < T, a.s. For any 1^,(7 d 5o.t with < cr, a.s., we define Si^u = {p G 
So,T \ V < p < a, a.s.} and let ^ denote all finite- valued stopping times in S^^a- We let T) = {fc2^" | fc G Z, n G N} 

denote the set of all dyadic rational numbers and set 2?t = ([0,2^) n 2?) U {T}. For any t G [0,r] and n G N, we 
also define 

..d .tw^ifiAT. ,1.9) 

It is clear that q^it), qt{t) G T^t- 

In what follows we let F' be a generic sub-cr-field of !F and let B be a generic Banach space with norm | ■ |b- 
The following spaces of functions will be used in the sequel. 

(1) For < p < cx), we define 

• LP(J^';B) to be the space of all B-valued, J^'-measurable random variables ^ such that -EdCli) < 00. In 
particular, if p = 0, L'^{F']M) stands for the space of all B-valued, J^'-measurable random variables; and 

\i p = 00, L°°{T']M) denotes the space of all B-valued, J^'-measurable random variables ^ with l|^l|oo = 

esssup |C(w)|b < 00. 
wen 

• ip([0, T] ; B) to be the space of all B-valued, F-adapted processes X such that E \Xt \^dt < 00. In particular, 
if p = 0, Lp([0,T];B) stands for the space of all B-valued, F-adapted processes; and ii p = 00, i^([0,T];B) 

denotes the space of all B-valued, F-adapted processes X with ||X||oo = esssup |X4(w)|b < 00. 

• C^([0,T];B) ^ {X G L^([0,T];B) : X has continuous paths}. 

• H^{[0,T];M) = {X e L^([0,T];B) : X is predictably measurable}. 

(2) For p > 1, we define a Banach space 

MP([0,T];B) - |x G H^([0,T];B) : \\X\\m. ^ [^[i £ l^slldsY^'] | < ooj, 

and denote Mf([0,T];B) = n Af^([0, T]; B). 

(3) We further define 

L''{T';M) = G /."(J-^B) : i;[e-^l«l»] < 00 for ah A > 0}, 
CF([0,r];B) = |x G CF([0,r];B) : i;[exp{A sup |Xt|B}j < 00 for ah A > o|. 
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If d = 1, we shall drop M = R from the above notations (e.g., L^{[0,T]) = L^([0,T];R), LP{Tt) = LP{I't;S-)) ■ In 
this paper, all F-adapted processes are supposed to be real-valued unless specifying otherwise. 

2 F-expectations and Their Properties 

We will define non-linear expectations on subspaces of L'^{J^t) satisfying certain algebraic properties, which are 
listed in the definition below. 

Definition 2.1. Let 'St denote the collection of all non-empty subsets A of L'^{J-t) satisfying: 
{Dl) 0,1 e A; 

{D2) A is closed under addition and under multiplication with indicator random variables. Namely, for any ^,ri £ A 
and A G J-t, both S, + rj and belong to A; 

{D3) A is positively solid: For any £,,rj ^ L'^{J-t) with < (, < rj, a.s., if r] £ A, then ^ G A as well. 

Remark 2.1. (1) Each A £ is also closed under maximization "V" and under minimization "A"; In fact, for 
any ^,7] £ A, since the set > 77} G Tt, (D2) implies that ^ V 77 = ^1{^>,,} + r/l{^<,,j G A. Similarly, ^ A 77 G A; 

(2) For each A G St, (Di )-(D3) imply that c £ A for any c > 0; 

(3) St is closed under intersections: //{Aijigi is a subset of St , then n Ai G St; St is closed under unions of 

iei 

increasing sequences: If {A„}„gN C St such that A„ C An+i for any n G N, then U A„ G St; 

riGN 

(4) It is clear that LP{Tt) £ St for all < p < 00. 

Definition 2.2. An F-consistent non-linear expectation {F- expectation for short) is a pair {£, A) in which A G St 
and £ denotes a family of operators \^£[-\J^t] : A h- >■ Af ^ A n -^"(-^Oj^gjo t] satisfying the following hypothesis for 
any ^, 77 G A and t G [0, T] ; 

(Al) "Monotonicity (positively strict)": £[^\J-t\ < f[7y|J^f], a.s. if ^ < fj, a.s.; Moreover, «/ < ^ < 77 a.s. and 
£[^\J-'o] ~ £[r]\To], then ~ rj, a.s.; 

(A2) "Time Consistency" : £[£[S,\J-t]\J^s\ = £[i,\J's]: o-s. for any < s < t < T ; 
(A3) "Zero-one Law": £[lA(,\^t\ = '^A£[i,\^t\, a-s. for any A G Tt; 
(A4) "Translation Invariance": £[^ + ri\J-t] = £[(,\J-t] + rj, a.s. ifrjGAf. 
We denote the domain A by Dom{£) and define 

Dom^{£) ^ Dom{£)nL°{T^), \fiyeSo,T- 

For any ^, 77 G Dom{£) with £, = rj, a.s., (Al) implies that f [^|J^t] = £[ri\J't], a-s. for any t G [0,T], which shows 
that the F-expectation {£, Dom{£)) is well-defined. Moreover, since DomQ{£) — Dom{£) ni"(7^o) C L^{Fq) = M, 
£"[•1^-0] is a real- valued function on Dom{£). In the rest of the paper, we will substitute £[■] for £[-|J-o]. 

R emark 2.2. Our definition of F-expectations is similar to that of J- ^ -consistent non-linear expectations introduced 



m 



Pend \2OOi page 4]. 



Example 2.1. The following pairs satisfy (A1)-(A4); thus they are F-expectations: 
(1) {\^E\-\J-tW te[o,T]T {-FTy) ■ the linear expectation E is a special F-expectation with domain L^[J-t); 
2) (\ £a\-\J't]}fi=[n T], L'^jJ'r)) ■' the g- expectation with generator g{t., z) Lipschitz in z (see Peru, \l99'i l. Coquet et al. 



^20021] or Subsection \7. 1\ of the present paper); 

(3) {{£g[-\J-t]}te[Q.T]TL^{^Ty) ■ the g-expectation with generator g(t, z) having quadratic growth in z (see Subsection 
7.4\ of this paper). 
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F-expectations can alternatively be introduced in a more classical way: 
Proposition 2.1. Let £° : A H> R &e a mapping on some A G i^T satisfying: 

(al) For any ^, 77 e A with <rj, a.s., we have < i^^°[?7]- Moreover, if E°[S] = ^''M; then S, = rj, a.s.; 

{a2) For any ^ e A and t £ [0,T], there exists a unique random variable £ such that £°[lji^ + 7] = 
f + 7] holds for any A £ J^t and 7 G Af . 

Then {£[^\J^t] = ^t, ^ £ A}te [o,T] defines an Y- expectation with domain A. 

Remark 2.3. For a mapping £° on some A £ 2!t satisfying (al) and (a2), the implied operator £[-\J-q\ is also 
from A to M., which, however, may not equal to £° . In fact, one can only deduce that £°[S,] — £°\£[£\J-q]\ for any 

i£K. 

From now on, when we say an F-expectation £, we will refer to the pair (^£, Dom{£)) . Besides (Al)-(A4), the 
F-expectation £ has the following properties: 

Proposition 2.2. For any £,,ri £ Dom{£) and t £ [0, T], we have 

(1) "Local Property": £[lAi + lA'=ri\^t\ = lA£[i\^t\ + lA'=£[ri\J^t], a.s. for any A £ Ft; 

(2) "Constant-Preserving" : £[^\J-t] = ^, a.s. if S, £ Domt{£); 

(3) "Comparison" : Let ^,ri £ L^{Fv) for some v £ So,t- If V ^ a.s. for some c G R, then ^ < {or ~) rj, a.s. 
if and only if £[\aC\ {or =) £[\A'n\ foi" all A £ J-^. 

The following two subsets of Dom{£) will be of interest: 

Dom+{£) ^ {C e Dom{£) : C > 0, a.s.}, Dom*{£) = {£, £ Dom{£) : ^ > c, a.s. for some c = c{C) £ K}. (2.1) 

Remark 2.4. The restrictions of £ on Dom~^{£) and on Dom'^{£), namely {^£, Dom~^{£)^ and {£,Dorrv^{£)^ 
respectively, are both Y- expectations: To see this, first note that Dom~^{£) and Dom'^{£) both belong to S^t. For 
any t £ [0,T], (Al) and Provosition \2.2\ (2) imply that for any ^ £ Dom^{£) 

£[i\Ft\>£[c{(,)\Tt]^c{i), a.s., thus £[(\Ft] £ Dam* {£), 

which shows that £[-\Ft] maps Dom*{£) into Dam* {£) D L° {Ft) . Then it is easy to check that the restriction of 
£ = [■|.7^t]}jg[g on Donv^{£) satisfies (Al) to (A4), thus it is an F-expectation. Similarly, {£,Dom'^{£)^ is 
also an F-expectation. 

We should remark that restricting £ on any subset A' of Dom{£), with A' G S^t, may not result in an F- 
expectation, i.e. {£,A') may not be an F-expectation. 

Definition 2.3. (1) An F-adapted process X — {Xt}t£[o^T] called an "£-process" if Xt £ Dom{£) for any 
t£[0,T]; 

(2) An £-process X is said to be an £-supermartingale (resp. £-martingale, £ -submartingale) if for any < s < 
t < T, £[Xt\Ts] < {resp. >) X^, a.s. 

Given a G Sqj^ taking values in a finite set {ti < ■ ■ ■ < t„}, if X is an f-process, (D2) implies that 

Xiy = ^^i^i'i-{i/=ti}Xti G Dom{£), thus X^ £ Domy{£). Since {X^ = £[^\Ft]} ^^^^ j,^ is an f-process for any 
^ G Dom{£), we can define an operator £[-1^^] from Dom{£) to Dom^{£) by 

^[Cl-^i'] ^ ^li^ for any £, £ Dom{£), 
which allows us to state a basic Optional Sampling Theorem for £. 

Proposition 2.3. (Optional Sampling Theorem) Let X be an £-supermartingale (resp. £-martingale, £ -submartingale). 
Then for any v,a £ S^rp, £[X^\F'a-] < {resp. —, '>)Xi,/\a-, a.s. 
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In particular, applying Proposition 12 . 31 to each f-martingale {f [^|7^t]}tg[o^T]j in which ^ e Dom{£), yields the 
following result. 

Corollary 2.1. For any G Doni{£) and v,a £ S^j,, £\£[^\Fy\\F^'\ = £[^\Tyf~,^], a.s. 

Remark 2.5. Corollarv \2.1\ extends the "Time-Consistency" (A2) to the case oj finite-valued stopping times. 

£[-\J-i,] inherits other properties of as well: 

Proposition 2.4. For any £,,ri ^ Dom{£) and v G S^rj,, it holds that 

(1) "Monotonicity (positively strict)": £[^\J-^\ < £[ri\J-i,], a.s. if ^ < rj, a.s.; Moreover, «/ < ^ < 77, a.s. and 
£[^\J-o-] = ^['yl-^cr], a.s. for some a e S^j., then ^ = rj, a.s.; 

(2) "Zero-one Law": £[1a^\J-u] = 1a£[£,\J'i^], o,-s. for any A G Jv; 

(3) "Translation Invariance" : £[S^ + ri\J-y\ = £[S^\J-i,] + rj, a.s. if rj G Dom^{£); 

(4) "Local Property": £[1a£. + — 'i-A£[S.\J^iy] + 1^=^ a.s. for any A G Jv; 

(5) "Constant-Preserving" : £[(^\J-^] = ^, a.s., if S, G Dom^{£). 

We make the following basic hypotheses on the F-expectation £. These hypotheses will be essential in developing 
Fatou's lemma, the Dominated Convergence Theorem and the Upcrossing Theorem. 

Hypotheses 

(HO) For any A e Ft with P{A) > 0, we have hm = 00; 

(HI) For any ^ G Dom^{£) and any {A„}„gN C J-t with hm t 1a„ — 1, a-S., we have lim t£[l^,^^] = £[(]\ 

(H2) For any ^, ?7 G -Dom+(f) and any {A„}„gN C J^T with lim 4, 1a„ = 0, a.s., we have lim |£ + l^i^^ry] = f [^]. 

Remark 2.6. The linear expectation E on L^{J-'t) clearly satisfies (H0)-(H2). We will show that Lipschitz and 
quadratic g- expectations also satisfy (H0)-(H2) in Propositions 1 7. _?] and 1 7. 5| respectively. 

The F-expectation £ satisfies the following Fatou's Lemma and Dominated Convergence Theorem. 

Theorem 2.1. (Fatou's Lemma) (HI) is equivalent to the lower semi- continuity of £: If a sequence {S,n}nefi C 
Dom^{£) converges a.s. to some ^ G Dom^{£), then for any v G S^j,, we have 

£{i\T.\ < \jm£[^n\J'.], a.s., (2.2) 
where the right hand side of i2. ^|) could be equal to infinity with non-zero probability. 

Remark 2.7. In the case of the linear expectation E , a converse to h2. holds: For any non-negative sequence 
{?n}neN C L^(J-t) that converges a.s. to some ^ G L'^{J-'t), if lim < 00, then ^ G L^(J-t). However, 

this statement may not be the case for an arbitrary F-expectation. That is, lim £[S,n] < 00 may not imply that 

^ G Dom^(£) given that {^ri}neN C Dom'^{£) is a sequence convergent a.s. to some ^ G L^{J-t). {See Example 
\7.1\ for a counterexample in the case of a Lipschitz g -expectation.) 

Theorem 2.2. (Dominated Convergence Theorem) Assume (HI) and (H2) hold. Let {^n}„eN be a sequence in 
Dom^{£) that converges a.s. If there is an rj ^ Dom^{£) such that < 77 a.s. for any n G N, then the limit ^ of 
{fnlnsN belongs to Dom^{£), and for any v G S^rj^, we have 

lim £{in\Ti\ = £[^\T^], a.s. 
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Next, we will derive an Upcrossing Theorem for f-supermartingales, which is crucial in obtaining an RCLL 
(right-continuous, with limits from the left) modification for the process J^(]}jgjQ as long as ^ G Dom{£) 
is bounded from below. Obtaining a right continuous modification is crucial, since otherwise the conditional 
expectation £^[^|J^y] may not be well defined for any v G <So,t- 

Let us first recall what the "number of upcrossings" is: Given a real-valued process {-'^t}te[o,T] and two real 
numbers a < b, for any finite subset F of [0,T], we can define the "number of upcrossings" UF{a,b; X{uj)) of the 
interval [a, b] by the sample path {Xt{uj)}teF as follows: Set i^q — —1, and for any j — 1,2, ■ ■ ■ we recursively define 

i^2j-i(t^) = min{t £ F : t > i'2j -2i^^), Xt{uj) < a} AT £ Sq^, 
i/2j(w) = min{t e F : t> z^2j-i (w), Xt(w) > b} AT e Sq^, 

with the convention that min = cc. Then Upia, b; X{u!)) is defined to be the largest integer j for which i'2j{^) < T. 
If / C [0,T] is not a finite set, we define 

Ui (a, 6; X{(jj)) ^ sup{t/F(a, b; X{uj)) : F is & finite subset of /}. 

It will be convenient to introduce a subcoUection of 

#T = {A £ : M C A} . 

Clearly, contains all Lp{J^t), < p < oo. In particular, L°°{Ft) is the smallest element of in the following 
sense: 

Lemma 2.1. For each A G ^t, L°"{Ft) C A. 

Proof: For any ^ G L°°(-Ft), we have -||^||oo, 2||^||oo G R C A. Since < f + ||f||oo < M\\oo, a.s., (D3) implies 
that + ll^lloo e A. Then we can deduce from (D2) that ^ = (C + ||$||oo) + (-||$||oo) e A. □ 

For any F-adapted process X , we define its left-limit and right-limit processes as follows: 
X^ = lim X^-f^^. and X+ = fim X^+,^y for any t G [0,r], 

where q^it) and q^it) are defined in ()1.9p . Since the filtration F is right-continuous, we see that both X~ and X^ 
are F-adapted processes. 

It is now the time to present our Upcrossing Theorem for f-supermartingales. 

Theorem 2.3. (Upcrossing Theorem) Assume that (HO), (HI) hold and that Dom{£) G ^t- For any £-supermartingale 
X, we assume either that Xt > c, a.s. for some c G M or that the operator £[■] is concave: For any ^,r] G Dom{£) 

£[X^ + (1 - \)7]] > X£[^] + {1 - X)£[7^], VAg(0,1). (2.3) 

Then for any two real numbers a < b, it holds that P{UD^{a, b; X) < cxd) = 1. Thus we have 

P(x- ^ lim X-i,. and X+ = lim X +,,^ for any t G [Q,T] \ = 1. (2.4) 

As a result, X^ is an RCLL process. 

In the rest of this section, we assume that the F-expectation £ satisfies (II0)-(H2) and that Dom{£) G i^r- The 
following proposition will play a fundamental role throughout this paper. 

Proposition 2.5. Let X be a non-negative £-supermartingale. (1) Assume either that essswp Xt G Dom^{£) or 
that for any sequence {Cn}neN C Dom^{£) convergent a.s. to some ^ G L^{Ft), 

lim £[^„] < oo implies ^ G Dom^{£). (2-5) 
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Then for any v G Sq^t, and both belong to Dom^ {£); 

(2) If X+ e Dom+{£) for any t G [0,r], then X+ is an RCLL £-supermartingale such that for any t G [0,r], 
X+ < Xt, a.s.; 

(3) Moreover, if the function t ^ £[Xt\ from [0,r] to M is right continuous, then X^ is an RCLL modification of 
X. Conversely, if X has a right- continuous modification, then the function t ^ £[Xt\ is right continuous. 

Now we add one more hypothesis to the F-expectation £: 
(H3) For any i G Dora+{£) and v G 5o,t, Xl'+ G Dom+{£). 

In hght of Proposition 12.51 fl). (H3) holds if esssupf G Dorn^{£) or if £ satisfies (I2.5p . 

For each ^ G Dorn^{£), we define ^' = ^ — c(^) G Dom^{£). Clearly X^' ^ {^[C'l-^t] }tg[o t] ^ non-negative 
f-martingale. By (A2), £[xf] = £ [£[^'1 = £[C] for any t G [0,r], which means that t ^ £[xf] is continuous 
function on [0,r]. Thanks to Proposition [13] (2) and (H3), the process xf = lim X^' t G [0,r] is an RCLL 

modification of . Then for any u G So,t^ we define 

f[C|J-.]=X«'-++c(e) (2.6) 

as the conditional F-expectation of ^ at the stopping time v G Sq^t- Since we have assumed Dom{£) G Lemma 
12.11 (H3), (D2) as well as the non- negativity of X^ imply that 

f [Cl-F,] G Dom*{£), (2.7) 

which shows that f [-j^i/] is an operator from Dom'^{£) to Domf{£) = Dom'^{£)r\L°{J^^). In fact, [-iJ^tJl^gji^ 
defines a F-expectation on Dom'^{£), as the next result shows. 

Proposition 2.6. For any ^ G Donv^{£), £[^\T.] is an RCLL modification of £[S^\T.]. {^£[-\J-t\} ^^^^ j,^ is an 

F-expectation with domain Dom{£) = Dorn^{£) G &t o,nd satisfying (H0)-(H2); thus all preceding results are 
applicable to £ . 

Proof: As Dom{£) G is assumed, we see that Donv^{£) also belongs to &t- Fix ^ G Dom'^{£). Since X^ ■+ 
is an RCLL modification of X^ , (A4) implies that for any t G [0, T] 

mTt] = Xf++c{i) = £[i'\Ft] + c{0 = £[i' + c{i)\Tt] = £[i\Tt\, a.s. (2.8) 

Thus f is actually an RCLL modification of Then it is easy to show that the pair (£,Dom^{£)) 

satisfies (Al)-(A4) and (II0)-(II2); thus it is an F-expectation. □ 

We restate Proposition 12.51 with respect to £ for future use. 

Corollary 2.2. Let X be an £-supermartingale such that essinf > c, a.s. for some c G M. 

te[o,T] 

(1) If esssup Xt G Dom'^{£) or if \2. 5]) holds, then both X~ and A"+ belong to Dom^{£) for any v G iSq.t/ 

(2) If X^ G Dom'^{£) for any t G [0,r], then X^ is an RCLL £ -supermartingale such that for any t G [0,r], 
X+ < Xt, a.s. 

(3) Moreover, if the function t H> ^[^"4] from [0,r] to M is right continuous, then X^ is an RCLL modification of 
X. Conversely, if X has a right- continuous modification, then the function t ^ £[Xt] is right continuous. 

The next result is the Optional Sampling Theorem of £ for the stopping times in iSo,t- 
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Theorem 2.4. ( Optional Sampling Theorem 2) Let X be a right- continuous 8 -supermartingale (resp. 8 -martingale, 
8-submartingale) such that essinf > c, a.s. for some c G M. If X^ G Dorrv^{8) for any v G 5o,T; then for any 

i^, (T G 5o,T, we have 

8[X^\Ta] < {resp. =, >)XyAa, a.s. 

Using the Optional Sampling Theorem, we are able to extend Corollary 12.31 and Proposition 12.41 to the operators 
f ['IJ"^], ly G 5o,T- 

Corollary 2.3. For any ^ G Dom'^{8) and v,a € Sq,t, we have 

f =£KI^.A.], a.s. (2.9) 

Proof: Since (^8,Dom'^{8)) is an F-expectation by Proposition 12.61 for any ^ G Dom^{8), (A2) implies that the 
RCLL process X^ = {^Kl-^t] }tg[Q j^j is an ^-martingale. For any t G [0, T], Proposition (12.81) and l2.2l f2) show that 

X^t = m^t] > SHi)\Tt] = S[c{i)\Ft] = c(0, a.s., 
which implies that essinf > c(^), a.s. Then (|2.7p and Theorem 12 .41 give rise to p.9p . □ 

Proposition 2.7. For any £,,ri ^ Dom^{8) and v G 5o,t, it holds that 

(1) "Strict Monotonicity": < £[77] Jv], a.s. if <rj, a.s.; Moreover, if 8[S,\J-a] = £[77! a.s. for some 
cr G Sq,t, then £, — rj, a.s.; 

(2) "Zero-one Law": 8[1aS,\'Fv\ — '^a8[C\^i>\, a.s. for any A G F,^; 

(3) "Translation Invariance": 8[£, -\- ri\J-^] — 8[£,\J^u] -\- rj, a.s. if rj ^ Domf{8); 

(4) "Local Property": 8[1aC + Ia^vIJ'u] = IaSI^IJ'u] + Ia^SIvIJ'u], a.s. for any A G T^; 

(5) "Constant-Preserving" : 8[S]J-i,] = ^, a.s., if £, ^ Domf{£). 

Remark 2.8. Corollary \2.S[. Proposition \2.7\ (2) and i2. 8\) imply that for any ^ G Donrv^{E) and v G Sq,t, 

e{\Ai\ = l{\Ai\ = e\£{\Ai\Tj^ = £[iAmj^.]\ - £[1^^ Kl^.]], g j-.. (2.10) 

In light of Provosition [27B (3), £[^|J-"y] is the unique element (up to a P-null set) in Domf{£) that makes i2. 1 0\) 
hold. Therefore, we see that the random variable £[^1^^] defined by (|2.6p is exactly the conditional F-expectation 
of ^ at the stopping time v in the classical sense. 

In light of Corollarv l2 .31 and Proposition l2.7[ we can generalize Fatou's Lemma (Theorem l2.ip and the Dominated 
Convergence Theorem f Theorem 12. 2p to the conditional F-expectation E\-\Ti\, v G Sq,t. 

Proposition 2.8. (Fatou's Lemma 2) Let {£,n}n<EN be a sequence in Dom*{£) that converges a.s. to some ^ G 
Dom'^iE) and satisfies essinf > c, a.s. for some c G M, then for any v E Sot, we have 

fiei^F.] < limf[e„|J".], a.s., (2.11) 
where the right hand side of i2.11]) could be equal to infinity with non-zero probability. 

Proposition 2.9. (Dominated Convergence Theorem 2) Let {^n}n<=N be a sequence in Dom*{£) that converges 
a.s. and that satisfies essinf ^„ > c, a.s. for some c G M. // there is an rj ^ Dorn^{£) such that ^„ < 77 a.s. for any 

n G N, then the limit ^ o/{^„}„gN belongs to Dom'^{£) and for any v G 5o,T, we have 

lim£[e„|J-.] =f[^|J-.], a.s. (2.12) 

n— >oo 

Proof of Proposition 12.81 and 12. 9t In the proofs of Theorem 12.11 and Theorem 12.21 we only need to replace 
{CnjneN and i?[-|.7^t] by — c}„eN and respectively. Instead of (Al), (A3) and (A4), we apply Proposition 

12.71 (l)-(3). Moreover, since (A2) is only used on Dom^{£) in the proofs of Theorem 12.11 and Theorem 12. 2( we can 
substitute Corollary 12.31 for it. Eventually, a simple application of Proposition [2771 f3) yields (|2.1ip and (|2.12p . □ 
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3 Collections of F- Expect at ions 

In this section, we will show that pasting of two F-expectations at a given stopping time is itself an F-expectation. 
Moreover, pasting preserves (HI) and (H2). We will then introduce the concept of a stable class of F-expectations, 
which are collections closed under pasting. We will solve the optimal stopping problems introduced in (jl.l[) and 
p.6p over this class of F-expectations. Before we show the pasting property of F-expectations, we introduce the 
concept of convexity for an F-expectation and give one of the consequences of having convexity: 

Definition 3.1. An F-expectation £ is called "positively- convex" if for any S,,ri ^ Dorn^ {£), A G (0,1) and 
t e [0, T] 

£[\i + (1 - X)7^\Ft] < X£[C\Tt] + (1 - X)£[v\^tl a.s. 

Lemma 3.1. Any positively- convex F-expectation satisfies (HO). Moreover, an F- expectation £ is positively- convex 
if and only if the implied F-expectation (f,£'om^(£)) is convex, i.e., for any ^,?7 G Dom'^{£), A G (0,1) and 

te[0,T] 

£[Xi + (l - X)ij\Tt] < Xm^t] + (l - X)£[v\Tt], a.s. (3.1) 

Proposition 3.1. Let £i,£j be two F-expectations with the same domain A G S>t and satisfying (H1)-(H3). For 
any v G iSo,t, we define the pasting of £i,£j at the stopping time v to be the following RCLL F -adapted process 

£l,[(,\Tt] = l{,<t}£j[i\Ft] + l{,>t}£,[£',[e|J-.]|J-t], Vi G [0,T] (3.2) 

for any ^ G A"^ = G A : ^ > c, a.s. for some c — c(^) G M}. Then £^j is an F-expectation with domain 
\# G and satisfying (HI) and (H2). Moreover, if £i and £j are both positively-convex, £^j is convex in the 
sense of ()3.ip . 



In particular, for any a G So,t, applying Proposition 12. 71 (4) and (5), we obtain 

£^^^[i\T,] = l[,<^}£j[^\T,] + l{,>^}£^[£j[C\T,]\T„] - l{,<,}£,[£,[e|J-.]|-F,] + l{.>.}£'.[fjKI^.]|^.] 

= St[l{u<a}Sj[£,\J^a] + l{u>a}Sj[£.\J^i.]\j^a] ^ £i[£j[^\J^,.Va]^^ a.S., (3.3) 



where we used the fact that {ly > a} E J-i,/\a thanks to iKaratzas and Shrevd 199ll Lemma 1.2.16]. 



Remark 3.1. Pasting may not preserve (HO). From now on, we will replace the (HO) assumption by the positive 
convexity, which implies the former and which is an invariant property under pasting thanks to the previous two 
results. Positive convexity is also important in constructing an optimal stopping time of p.ip (see Theorem \4.1^ . 

All of the ingredients are in place to introduce what we mean by a stable class of F-expectations. As we will 
see in Lemma stability assures that the essential supremum or infimum over the class can be approximated by 
an increasing or decreasing sequence in the class. 

Definition 3.2. A class S" — {£i}iex of F -expectations is said to be "stable" if 

(1) All £i, i £l are positively- convex F-expectations with the same domain A G &t and they satisfy {H1)-[H3); 

(2) S is closed under pasting: namely, for any i, j E T, v E Sq.t, there exists a k = k{i,j,v) G I such that £'j) ^ 
coincides with £k on A"^ . 

We shall denote Dom{<g) = K* , thus Dom{<g) = Dom*{£i) G for any i ET. Moreover, if S" ~ {£i}i<£i' 
satisfies (2) for some non-empty subset X' of I, then we call S' a stable subclass of S , clearly Dom{S") = Dom{S). 

Remark 3.2. The notion of "pasting" for linear expectations was given by Follmer and Schiec \200A . Definition 



6.41]. The counterpart of Proposition for the linear expectations, which states that pa sting two probability 
measures equivalent to P results in another probability measure equivalent to P , is given by Follmer and Schieci 
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'200l Lemma 6.4-3]. Note that in the case of linear expectations, (HI), (H2) and the convexity are trivially 



preserved because pasting in that case gives us a linear expe ctation. On the other hand, the notion of stability for 
linear expectations was given by Fdllmer and Schieci \200Ji . Definition 6.44]- The stability is also referred to as 



"fork convexity" in .stochastic control theory, "m-stability" in stochastic analysis or "rectangularity" in decision 
theory (see the introduction of Delbaerl [2006 1 for details). 



Example 3.1. (1) Let V be t he set of all probabil ity measures equivalent to P, then S-p = {Eq\q^-p is a stable 



class of linear expectations; see Fdllmer and Schie<\ '2004 ■ Proposition 6.45]. 
(2) Consider a collection il of admissible control processes. For any [/ g il, let P^ be the equivalent probability 
measure defined via \Karatzas and ZamHrescu \200i (5)] (or \Karatzas and ZamHrescil \200d . (2.5)]), then <fii 



A 



{Epu^Us^iX is a stable class of linear expectations; see Subsection \7.!^ of the present paper. 

(3) For any M > Q, a family S'm of convex Lipschitz g- expectations with Lipschitz coefficient Kg < M is an example 
of stable class of non-linear expectations; see Subsection\7 . 1\ of this paper. 



The following Lemma gives us a tool for checking whether a random variable is inside the domain Dom{S') of 
a stable class . 

Lemma 3.2. Given a stable class S of Y -expectations, a random variable ^ belongs to Dom{S) if and only if 
c < C ^ '7? '^•■S- for some c G M and rj G Dom{S'). 

Proof: Consider a random variable ^. If ^ € Dom{S'), since Dom{S') = Dom^{£i) for any i G X, we know that 
there exists a c = c(^) G M such that ^ > c(^), a.s. 

On the other hand, if c < ^ < 77, a.s. for some c G K. and 77 G Dom{S'), it follows that 0<£, — c<ri — c, a.s. 
Since Dom(S') G 9t, we see that -c, c G M C Dom(S'). Then (D2) shows that t] - c G Dom{S) and thus (D3) 
implies that ^ — c G Dom{S'), which further leads to that ^ = — c) + c G Dom{S') thanks to (D2) again. □ 



We end this section by reviewing some basic properties o f the essential supremum a nd essential infimum (for 
their definitions, see e.g. Neveul 1975 . Proposition VTl-1], or Follmer and Schiedl 2004 . Theorem A. 32]). 

Lemma 3.3. Let {S,j}jeJ O'f^d {"Hj^jeJ &6 families of random variables of L'^{J-) with the same index set J . 

(1) U ^ {—) "Hj! '^•■s- for any j G J , then esssup^j < {—) esssup?7j , a.s. 

(2) For any A J-, it holds a.s. that esssup (lyi^j + I/ict;-,) = l^iesssup^j + lA<:esssup77j; In particular, 
esssup(lA^j) — l^esssup^j, a.s. 

(3) For any random variable 7 G L^{F) and any a> 0, we have esssup (a^j + 7) = aesssup^j + 7, a.s. 
Moreover, (l)-(3) hold when we replace esssup by essinf . 



4 Optimal Stopping with Multiple Priors 

In this section, we will solve an optimal stopping problem in which the objective of the stopper is to determine an 
optimal stopping time r* that satisfies 

sup £^[Yp + H;] = sup E.\Yr-^ +Hr.], (4.1) 

where = {Si}iex is a stable class of F-expectations, V is a primary reward process and W is a modeZ-dependent 
cumulative reward process. (We will outline the assumptions on the reward processes below.) To find an optimal 
stopping time, we shall build a so-called "(f-upper Snell envelope" , which we will denote by of the reward process 
Y. Namely, Z'^ is the smallest ROLL F-adapted process dominating Y such that Z° + W is an £i-supermartingale 
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for any j G I. We will show under certain assumptions that the first time Z'^ meets Y is an optimal stopping time 
for 

We start by making some assumptions on the reward processes: Let (o — {£i]i^i be a stable class of F- 
expectations accompanied by a family = {H^}iei of right-continuous F-adapted processes that satisfies 

(51) For any i ^ I, Hq — 0, a.s. and 

K,p = ^ Dom{S), Vz/, p G 5o,T with v < p, a.s. (4.2) 

Moreover, if no member of <S satisfies (|2.5p . we assume that there exists a j G I such that 

= esssup Hi ^ G Dom{<g). (4.3) 

s,t£VT;s<t 

(52) There exists a Ch < such that for any i G I, essinf HI j > Ch, a.s. 

(53) For any v G 5o,t and i,j G I, it holds for any < s < t < T that H^^. — i?^As,i/At + -f^i^vs,i/vt' where 
A: = k(i,j, I/) G X is the index defined in Definition 13.21 (2). 

Remark 4.1. (1) For any i El, (S2) and the right- continuity of imply that except on a null set N{i) 

Hi t > C'h: for any < s < t < T, thus H^ p > Cr, ^ i^, P e 5o,t with v < p, a.s. (4.4) 

(2) If (j4.3p is assumed for some j G I, we can deduce from the right- continuity of and (j4.4p that except on a 
null set N 

Ch < Hg J < C"*, for any < s < t < T, thus Ch < HI p < , v, p E 5o,t with v < p, a.s. 

Then Lemma \3.2\ implies that (|4.2p holds for j . Hence we see that (j4.3p is a stronger condition than (|4.2p . 

(3) Since H^ , H^ and H^ are all right- continuous processes, (S3) is equivalent to the following statement: It holds 
a.s. that 

= K^s,.M + ^;^vs..vt, V < 5 < i < T. (4.5) 

Now we give an example of J^tf. 
Lemma 4.1. Let {h'^}ii=x be a family of progressive processes satisfying the following assumptions: 

(hi) For any i G X and v,p (z Sq^t with v < p, a.s., J^h\dt G Dom{S'). Moreover, if no member of S satisfies 
Ii2.5\) . we assume that there exists a j El such that \h{ \ dt G Dom{<S). 

(h2) There exists a c < such that for any i eT, h\ > c, dt x dP-a.s. 

(hS) For any v E Sq_t o,nd i,j E T, it holds for any < s < t < T that h\ = l|i^<(}ft,( + l^^ytjhl, dt x dP-a.s., 
where k — k(i,j, eT is the index defined in Definition \3.2\ (2). 

Then {Hi = kids, t E [0, T]}^ _ is a family of right- continuous F-adapted processes satisfying (S1)-(S3). 

Standing assumptions on Y in this section. 

Let F be a right-continuous F-adapted process that satisfies 
(Yl) For any v E So,t, Y^ E Dom{S). 
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(Y2) sup £i [Fp] < oo, where = {Yt + i/j}tg[o^T]- Moreover, if no member of <S satisfies (|2.5p . then we 

(i,p)GlxSo,T 

assume that 

Cy = esssup £i[Y'p\Tt] Dom{S). (4.6) 

(i,p,t)Glx5o,TXX'T 

(Y3) essinf Ft > Cy, a.s. for some Cy < 0. 

Remark 4.2. (1) For any i ^X, (AA) and 112. 8\} imvlv that Si satisfies 112. 5\) if and only if Si satisfies the following: 
Let {£,n}n£fi C Dom((S') be a sequence converging a.s. to some ^ G L^{J-t). If inf ^„ > c, a.s. for some c S M, 

riGN 

then lim 5i[^„] < oo implies ^ G Dom{(§). The proof of this equivalence is similar to that of Corollarv \2.2\ 

n— >oo 

(2) It is clear that (14. 6p implies sup Si [y^] < oo. 

(i,p)eix5o,T 

('^j /n Zi^/it o/ (Y3) and the right- continuity ofY, it holds except on a null set N that 

Yt>CY, Vte[0,T], thus Y^>Cy, yiy(ESo,T. (4.7) 
Then for any i G X, Remark \4-.1\ (1) implies that except on a null set N{i) 

y: ^Y, + Hl>a^CY + CH, V G So.T- (4.8) 

The following lemma states that the supremum or infimum over a stable class of F-expectations can be ap- 
proached by an increasing or decreasing sequence in the class. 

Lemma 4.2. Let v G 5o,t and hi be a non-empty subset of S^.t such that 

PiIa + P2lyi- G iY, Vpi,p2GW, yAeFy. 

Let {X{p)}p(^u C Dom(S') be a family of random variables, indexed by p, such that for any v^a ^lA, = 
l{u=o}X{a), a.s., then for any stable subclass S' = {fijiei' of S , there exist two sequences {{i 

niPnJjnGM ana 

{{i'n, Pn)}nGN in I' X U such that 

esssup S^[X{p) + HlM = lim^ S,„[X {pn) + HI" a.s., (4.9) 

(i,p)Gl'xW .P"i -i 

essinf S,[Xip) + HlM = lim i S,, [X [plJ + H^", , a.s. (4.10) 

For any ly G 5o,t and i G I, let us define 

Z{j^)= esssup S^[Yp + HIJT^] e and Z\iy) ^ Zii') + HI. 

Clearly, taking p = v above yields that 

Y^ < Z{v), a.s. (4.11) 

The following two Lemmas give the bounds on Z{iy), Z'^{v), i G I, and show that they all belong to Dom{S'). 
Lemma 4.3. For any v G iSo,t o-nd i G X 

Z{v)>C^ and Z\v)>Cy^2Ch, a.s. (4.12) 
Moreover, if no member of S satisfies 112. 5\) . then we further have 

Z{v)<Cy~Ch and Z'(l') < (y - Ch + Hi, a.s., (4.13) 
where Cy — Ch and ^y — Ch + HI both belong to Dom{S). 
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Lemma 4.4. For any v e 5o,t Ound i £ I, both Z{v) and Z^(y) belong to Dom{S'). 

In the next two propositions, we will see that the F-adapted process {Z{t)}t£[Q T] has an RCLL modification 
Z°, and that both {Z^{t)^^^^^ and Z^'° = {Zt + -^t }tg[o t] fi-supermartingales for any i e I. 
Proposition 4.1. For any v,a Sq^t and 7 e S,y^T, we have 

Z{v) = Z{a), a.s. on {v^ a}, (4.14) 
esssupfi[Z(7) + i/^.^|J"^] = esssup £^[Yp + Hip\F^]<Z{v), a.s. (4.15) 

Proposition 4.2. Given i G I, /or anj/ v, p (z Sq^t with v < p, a.s., we have 

e,{Z\p)\T,\<Z\v), a.s. (4.16) 

In particular, |Z*(t)}^^jjj is an £i-supermartingale. Moreover, the process {^(0}tg[oT] an RCLL modi- 
fication Z^\ The process Z^''^ = {Z^ -\- }(g[g j^j *s «^so an £i-supermartingale. 

We call Z° the "<f -upper Snell envelope" of the reward process Y . From (|4.1ip and their right-continuity, we 
see that Z^ dominates Y in the following sense: 

Definition 4.1. We say that process X "dominates" process X' if P(^Xt > X[, Vt £ [0,T]) — 1. 
Remark 4.3. (1) If X dominates X' , then X^ > X^, a.s. for any v G iSq.t- 

(2) Let X and X' be two right- continuous F-adapted processes. If P{Xt > X^) = 1 holds for all t in a countable 
dense subset of [0,T], then X dominates X' . 

The following theorem demonstrates that Z° is the smallest RCLL F-adapted process dominating Y such that 
is an fi-supermartingale for any i G I. 

Proposition 4.3. The process Z*^ dominates the process Y . Moreover, for any v G Sq^t and i G I, we have 
Zl, Z]f G Dom{g) and 

Z°^Z{,y), rf^Z\v), a.s. (4.17) 

Furthermore, if X is another RCLL F-adapted process dominating Y such that X^ ^ {Xt + IIl'\te[o,T] is an 
£i-supermartingale for any i £ T, then X also dominates Z^ . 

As a consequence of Proposition 231 and (|4.12p . we have for any v G <So,t and i G I that 

^°>a, ZI'">Cy+2Ch, a.s. (4.18) 

In what follows, we first give approximately optimal stopping times. This family of stopping times will be crucial 
in finding an optimal stopping time for (j4.1l) . 

Definition 4.2. For any 6 G (0, 1) and v G <So.T; we define 

Ti{v) = inf {t G [z^, T]:Yt> SZ]^ + (1 - 5){Cy + 2Ch)} A T G S,,t 
and Js{y) = esssup -f^ 1-7^,.]. 

Remark 4.4. (1) For any 5 G (0,1) and v G iSo,T; ihe right- continuity of Y and Z'^ implies that {■'■(5(i)}tG[o,T] 
is also a right- continuous process. Moreover, since Z^ = Z(T) = Yt, a.s., we can deduce from (Y3) that Yt > 
5Z^ -f (1 — 5)(Cy + 2Ch). Then the right- continuity of processes Y and implies that 

> SZ^^^^ + (1 - S){Cy + 2Ch), a.s. 

(2) For any v G Sqj:, we can deduce from ^.17^ and ^.15^ that 

Js{v) = esssupf,[zO^(,) -t-i/^.,^(,)|j-,] = esssn^£,[Z{Ts{y))+Hl_^^^^^\T,] < Z{y) = Z^ a.s. (4.19) 
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The following two results show that for any S G (0, 1), the family {Js{i')}^^Sg j. possesses similar properties to 

Lemma 4.5. For any S £ (0,1) and v G <So,t, we have Jsiy) G Domes'). And for any a G iSo,t, J&(y) — J&{p\ 
a.s. on {v — cr}. 

Proposition 4.4. Given 5 G (0, 1), the followings statements hold: 

(1) For any i G I, {Jg{t) = Js{t) + ^^t}te[o,T] an £i-supermartingale; 

(2) { J|5(t)}tg[o,T] admits an ROLL modification J^'^ such that the process [o^T] 'is an £i- 
supermartingale for each i G T; 

(3) For any v G S^.t, Jt'° e Dom{(^) and J^'° = Js{i^), a.s. 

Fix 1/ G Sq^t- The right continuity of Z° and (|4.18p imply that the stopping times rsiiy) are increasing in S. 
Therefore, we can define the limiting stopping time 

T(i.) = limr,-H. (4.20) 

To show that r(0) G Sq^t is an optimal stopping time for (14. ip . we need the family of processes {Y^}i^x to be 
uniformly continuous from the left over the stable class S". 

Definition 4.3. The family of processes {i^'jigi is called "S' -uniformly-left-continuous" if for any v, p E So,t with 
V < p, a.s. and for any sequence {pn}nGN C Su,t increasing a.s. to p, we can find a subsequence {nk}k£n of N 
such that 



lim esssup 



^^[;i^^p.. -^^Kl-^-] =0' (4-21) 



The next theorem shows that t(i') is not only the first time when process Z'^ meets the process Y after f, but 
it is also an optimal stopping time after v. The assumption that the elements of the stable class (o are convex (see 
p.ip ) becomes crucial in the proof of this result. 



Theorem 4.1. Assume that {Y\i G 1} is "(o -uniformly-left-continuous" . Then for each v G iSq^t? I'he stopping 
time T{iy) defined by ^.20\ l satisfies 

Z{u) = esssup = esssup £IZ{t{v)) + Hi -^^jT^] = esssup £,[Z{p)+HljT^] , a.s. (4.22) 

iGT i^X i^X 

for any p G Sy Y{u) o.'^d, riy) — Ti(i>) ^ inf |t G [i^,T] : Z^ — Yt}, a.s. □ 
In particular, taking = in (|4.22p . one can deduce from (|2.8p that r(0) = inf {t G [0, T] : Z^ = Yt} satisfies 

sup [Yp + h;] = sup £, [Yp + h;] = Z(G) = sup £,[Y^^o) + ^7(0)] = sup ^.[^7(0) + ^t(o)] • 
(i,p)eixSo.T {i,p)eXxSo,T i^x iex 

Therefore, we see that t(0), the first time the Snell envelope Z° meets the process Y after time i = 0, is an optimal 
stopping time for (|4.ip . 



5 Robust Optimal Stopping 

In this section we analyze the robust optimal stopping problem in which the stopper aims to find an optimal 
stopping time that satisfies 

sup M £,[Y;]^M £,[Y;], (5.1) 
peSo.T '^2: lex 
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where S — {£i}i£x is a stable class of F-expectations and ^ Y + H'\ i G X is the mo del- dependent reward 
process introduced in (I5.ip . (We will modify the assumptions on the reward processes shortly). In order to find 
an optimal stopping time we construct the lower and the upper values of the optimal stopping problem at any 
stopping time ly € 5o,t, i-e., 




With the so-called "if-uniform-right-continuity" condition on {y }igx, we can show that at any v e 5o,t, and 
V{i') coincide with each other (see Theorem 15. II) . We denote the common value, the value of the robust optimal 
stopping problem, as ¥{1^) at i'. We will show that up to a stopping time t(0) (see Lemma . at which we have 
y(r(0)) = F^(o), a.s., the stopped value process {T^(t(0) A i)}(g[Q admits an RCLL modification V^. The main 
result in this section. Theorem 15. 2[ shows that the first time meets Y is an optimal stopping time for (|5.ip . 

Standing assumptions on ^ and Y in this section. Let us introduce 

i?'(i/) = esssup £i[Yp+ Hlp\Ty\, for any i G I and v G ^ct- 

To adapt the results we obtained for the family {Z[u)}y^So t to each family {R^{i')}i,^So n * £ assume that 

= {_ff*}igi is a family of right-continuous F-adapted processes satisfying (S2), (S3) and, 

(SI') For any i <E I, Hq = 0, a.s. and (|4.2p holds. If £i does not satisfy p.5|) . then we assume that C = 

esssup HI J. G Dom{S). 

s,teT)T-;S<t 

On the other hand, we assume that F is a right-continuous F-adapted process that satisfies (Yl), (Y3) and 

(Y2') For any i G X, sup Si [Y^] < 00. If £i does not satisfy (|2.5p . then we assume that esssup [^'1-^*1 G 
pe-So.T {p,t)eSo,TX'DT 

Dom(S'). 

We also assume that for any i G X, y is "quasi- left-continuous" with respect to £i: for any v, p (z So,t with v < p, 
a.s. and for any sequence {pn}neN C Siy_T increasing a.s. to p, we can find a subsequence {rifc — ri^*''}fcgN of N such 
that 

lira £,[^Yp^ +H;^ \T,]^£,[y;\T,], a.s. (5.2) 

Remark 5.1. (SI') and (Y2') are analogous to (SI) and (Y2) respectively while the quasi-left- continuity (|5.2I) is 
the counterpart of the S" -uniform-left- continuity (j4.2ip . R is obvious that (SI') implies (SI) and that (j4.21l) gives 
rise to (|5.2p . Moreover, (|4.6p implies (Y2'): In fact, for any i G X, one can deduce from (j4.8p that 

C* < esssup fi[^pl-^t] ^ esssup fi[yp|X't], a.s. 

(p,t)e5o,rxr>r (i,p,t)eIxSo,T xUt 

Then Lemma WM imvlies that esssup fji^'l-^t] G Dom{S'), and it follows that sup £i [Y^*] < 00. □ 

{p,t)GSa,TX-'DT P&So.T 

Fix i G X. Applying Lemma WM (|i?7)) . (|4.15p . Proposition H^l Proposition |331 and Theorem lO to the 

family {i?'(i/)}yg5g we obtain 

Proposition 5.1. (1) For any v G Sq,t, R^{v) belongs to Dom{S') and satisfies 

Cy <Y^ < esssup £i[Yp-\- HI p\T^]^ R\iy), a.s., thus <Yi, a.s. (5.3) 

pG5„,r 

(2) For any v,a <E Sq^t and 7 G S^^t, we have 

R\u) = R\a), a.s. on {v = a), (5.4) 

£,[R\-i) + Hl^^\T,] ^ esssnp£,[Yp + Hl^p\T,]<R\v), a.s. (5.5) 

pe5^,T 



Optimal Stopping for Non-linear Expectations 



18 



(3) The process admits an RCLL modification W''^ , called "£i Snell envelope", such that {Rl '^ + 
^t}te[o,T] "is an Si-supermartingale and that for any v £ iSo.t 

^ R\v), a.s. (5.6) 

(4) For any v G 5o,T> '''^i^) = inf{t G [^^T] : R^^ — Yt} is an optimal stopping time with respect to S"^ after time 
V, i.e., for any 7 G S^^r-(u), 

R\v) = + = ^R\t\v)) + = ^R\l) + Hl^^\F,l a.s. (5.7) 

Corollary 5.1. For any v G Sq,t, both ll(z^) and V{i') belong to Dom{S). 

Proof: Fix {l,p) G I x S,y^T, for any i G I, (|4Jl) . (|44|) and Proposition O (5) imply that 

[yp+ i/^pl-F,] > [Cy + ChI J-,] = a, a.s. 

Taking the essential infimum over i G X on the left-hand-side yields that 




Since R^{v) G Dom{S') by Proposition 15.11 (1). a simple application of Lemma [22] proves the corollary. □ 

As we will see in the next lemma since the stable class co is closed under pasting (see Definition 13.21 (2)), ¥{1^) 
can be approximated by a decreasing sequence that belongs to the family {i?'(i/)}igi. 

Lemma 5.1. For any v G Sq^t , there exists a sequence {in}neN C I such that 

V{i^) =essmiR\i^) = \imiR'"{v), a.s. (5.8) 

Thanks again to the stability of S" under pasting, the infimum of the family {T^{v)}iei of optimal stopping 
times can be approached by a decreasing sequence in the family. As a result the infimum is also a stopping time. 

Lemma 5.2. For any v G 5o,t,. there exists a sequence {i„},ieN C I such that 

r(i^) = essinf r'(i/) = lim|T'"(t^), a.s., thus z{^)^Sv^t- 

The family of stopping times {Tfi/)^^^So t ^i^l pl^-Y ^ critical role in this section. The next lemma basically 
shows that if £j and £k behave the same after some stopping time then R^'^ and R^'^ are identical after v. 

Lemma 5.3. For any i,j G X and v G iSq.Ti — k{i,j, v) as in Definition \3.2l For any a G Si,j:, we have 
iiJ'O = i?'=(cr) = R^a) = Ri^°, a.s. 

Proof: For any p G S^.t, applying Proposition 12. 71 (5) to £i, we can deduce from (|4.5|) and p.3p that 

£k [Yp + H^^p I J-,] - £k [Yp + HlJ\ T,] = £1^ [Yp + Hlp\F„]=£, [£, [Yp + HijT,y,]\ T,] 
= £, [£, [Yp + Hi^p\F„] I J-,] - £, [Yp + Hi^p\F,] , a.s. 

Then (|5.6p implies that 

= (a) = esssup £k [Yp + i?^,p | J".] = esssup £j [Yp + | J".] = W [a] = Wf, a.s., 

which proves the lemma. □ 

We now introduce the notion of the uniform right continuity of the family {F*}igx over the stable class (o. With 
this assumption on the reward processes, we can show that at any ly G 5o,t, ¥.{1^) = ^(i^)) a-S-, thus the robust 
optimal stopping problem has a value V{i') at v. 
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Definition 5.1. The family of processes {y*},;gx is called "S" -uniformly-right- continuous'' if for any v g iSo.T ond 
for any sequence {t'njneN C S^^t decreasing a.s. to v, we can find a subsequence of {iyn}n£ti (we still denote it by 
{t^n}neN) such that 



lim esssup 



— 0, a.s. 



Theorem 5.1. Suppose that {l^'jigi is "S -uniformly-right- continuous" . Then for any v G iSq.Tj we have 

Yiv) = es|inf J-,] ^ Y{v) > Y,, a.s. (5.9) 

We will denote the common value by V{i'){= V_{iy) = V{iy)). Observe that t{0) is optimal for the robust optimal 
stopping problem in (|5.ip . 

Standing assumption on Y for the rest of this section. We assume that the family of processes {F* j^gi is 
"(o'- uniformly-right-continuous" . 

Proposition 5.2. For any v e Sq,t, we have V{t_{v)) — Y^-^^-^, a.s. 

Note that t_[v) may not be the first time after v when the value of the robust optimal stopping problem is 
equal to the primary reward. Actually, since the process {V^(i)}te[o,T] is not necessarily right-continuous, inf{t 6 
[v^T] I V{t) =Yt \ may not even be a stopping time. We will address this issue in the next two results. 

Proposition 5.3. Given i Czl, for any v, p Sq^t with v < p, a.s., we have 

e&smi£u[V^{p)\T^]<V\v), a.s., (5.10) 

k^X 

where V'^{iy) = T^(i^) + HI E Dom[S). Moreover if p < I_{y), cl-s., then 

£^[V\p)\J^,]>V\j^), a.s. (5.11) 
In particular, the stopped process {V^*(t(0) A t) }jgjQ *s an Si-submartingale. 

Now we show that the stopped value process {V(t{0) At^ }te[o t] ^-dmits an RCLL modification V'^ . As a result, 
the first time when the process V'~' meets the process Y after time < = is an optimal stopping time of the robust 
optimal stopping problem. 

Theorem 5.2. Assume that for some i' G I, = esssup HI ^ e Domes') and that there exists a concave 

sJeVT;s<t 

F- expectation £' (not necessarily in S ) satisfying (HO) and (HI) such that 

Dom{£') D {— ^ : ^ G Dom(S)} and for every £i> -submartingale X, —X is an £' -supermartingale. (5.12) 

We also assume that for any p G 5o,Tj there exists a j ~ j{p) G I such that esssup £j [Y^ \ J-t] G Dom{S') . 

(1) Then the stopped value process {V^(t(0) ^i)}jg[Qy] admits an RCLL modification (called "S" -lower Snell 
envelope" of Y) such that for any v G 5o,T 

= V(T(fS) Kv), a.s. (5.13) 

(2) Consequently, 

TV - inf {i G [0, T] : V^'^ = (5.14) 
is a stopping time. In fact, it is an optimal stopping time of (|5.ip . 
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6 Remarks on Sections [4] &; [5] 
Remark 1. 

Let S — {£i}i^i be a stable class of F-expectations. For any ^ G Dom{S') and v E Sq^t, we define 
S'[^\J^u] ^ eassup£i[^\Tu] and ^[^| J",,] = essinf £^[^1 J"^] 

as the maximal and minimal expectation of ^ over # at the stopping time v. It is worth pointing out that 
is not an J^-expectation on Dom{S') simply because may not belong to Dom{<S) for some ^ S Dom{S') 

and t £ [0,T]. On the other hand, we will see in Example 16.11 that neither S' nor ^ satisfy strict monotonicity. 
Moreover, as we shall see in the same example, S does not satisfy (H2) while S_ does not satisfy (HI); thus we do 
not have a dominated convergence theorem for either S or Note also that S_ may not even be convex. 

Our results in Sections H] and [5] can be interpreted as a first step in extending the results for the optimal stopping 

problem sup £i\Yp], in which £i (i G I) is an F— expectation satisfying positive convexity and the assumptions 

peSo.T 

(H1)-(H3), to optimal stopping problems for other non-linear expectations, such as S" and which may fail to 
satisfy these assumptions. 

Example 6.1. Consider a probability space ([0, cxd), .^[0, oo), F ~ {J-'t}t>o, P) be a filtered probability space in 
which P is defined by 



P{A)^ [ g-^dx, VAe^[0,oo). 

J A 



We assume that the fi,ltration F satisfies the usual hypothesis. Let V denote the set of all probability measures 
equivalent to P. For any n € N, we define a Pn E V by 

P„(A) =n / e-"="da;, VAei^[0,oo). 

J A 

As discussed in Examvle \3.1\ S — {Eq^q^'p is a stable class. For any h > 0, one can deduce that 

1 =sup£;Q[l]>^[l[o.ft]] -supPq[1[o.,.]] > snpEp^[l[o,h]] = supP„[0,/^] = lini (l - e""'') = 1, 

QeV ' QeV nGN riGN "SN 

where we used the fact that Eq — Eq for any Q E V since Eq[£^\J-.] is an RCLL process for any ^ G ([0, cxd), 
^[0,oo),P). Hence, we have 

^[l[o,^]]-l, V/i>0, 
which implies that § does not satisfy strict monotonicity. 

Moreover, S does not satisfy (H2). For ^ — 0, rj — 1 and An — [0, n E N, it follows that 

lim + lA„ri] = lim ^[Ifq ii] = 1 ^ supPgp] = ^[0] 

On the other hand, it is simple to see that ^[l[h,oo)] — for any h > 0, which means that S_ does not satisfy 
strict monotonicity either. Furthermore, §_ docs not satisfy (HI). For ^ = 1 and An — oo), n £ N , we have that 

lim t^[lA„e] = lim m[±,oo)] = 7^ 1 = inf^^Q[l] - £[1] - ^K]- □ 

Although it does not satisfy strict monotonicity, ^ is almost an F-expectations on Dom{S') as we will see next. 

Proposition 6.1. For any t G [0,T], ^[-iJ^t] is an operator from Dom{S') to Domt{S) = Doni{S) nL'^{J-t). 
Moreover, the family of operators {^[•|-^t]}(g[Q satisfies (A2)-(A4) as well as 

^Kl-^t] < ^[??|-^t], CIS. for any ^, 7] G Dom{S') with S, < rj, a.s. (6.1) 
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We have found that the first time r(0) when the Snell envelope Z° meets the process Y is an optimal stopping 
time for l|4.ip while the first time Ty when the process V'~' meets the process Y is an optimal stopping time for 
(|5.ip . It is natural to ask whether t(0) (resp. Ty) is the minimal optimal stopping time of (|4.ip (resp. (|5.ip V This 
answer is affirmative when is a singleton. Let f be a positively-convex F-expectation satisfying (H1)-(H3) and 
let y be a right-continuous F-adapted process satisfying (Yl), (Y3) and the following 

sup £ [Yp] < oo; if <f does not satisfy (|2.5p . then esssup f [Ypl J^t] G Donr^{E). 

peSo,T (p,t)G5Q,T Xl>T 

(Note that we have here merged the cumulative reward process H into the primary reward process Y.) If t G 5o,t 
is an optimal stopping time for (|4.ip . i.e. sup £[Yp] — £[Yr], Proposition 14.21 and (|4.17|) imply that 

sup £[Yp] = sup £[Yp] = Z(0) > £[Z(r)] = £[Z^] ^ £[Z°] > £[Yr] = sup £[Ypl 

pG5o,r pe5o,T pGSo,T 

thus £[Z^] = The second part of (Al) then implies that = Yt, a.s. Hence r(0) < r, a.s., which means 

that t(0) is the minimal stopping time for (|4.ip . 

However, this is not the case in general. Let = {£i}i^x be a stable class of F-expectations and let F be a 
right-continuous F-adapted process satisfying (Y1)-(Y3). We take if ' = for any i G I. If r G Sq^t is an optimal 
stopping time for ()4.1|) . i.e. sup £i[Yp] = sup £i[Yr], (|4.15p and (|4.17p then imply that 

(i,p)eIx5o,T i&I 

sup = sup £,[Yp] = Z {0)> sup £^[Z{t)]= sup £^[Z{t)] 

(i,p)eix5o,T (i,p)£iy.So,T «ex iei 

= SUpfi[Z°] > SUp£4^r] = sup ^^i[^p]' 

ieX iGl (i,p)GlxSo,T 

thus S'[Z^] — sup £i[Z^'\ = sup £i[Yr] = S\Yt\. However, this may not imply that Z° = IV, a.s. since S" does not 
satisfy strict monotonicity as we have seen in Example 16.11 

Now we further assume that Y satisfies (Y2') , if r' G iSq t is an optimal stopping time for (|5.ip , i.e. sup inf £i [Yp] 

' pe5o,T*e^ 

= iui£i[Yr'], (fSlOl) and Theorem O imply that 

sup inf £i[Yp\ = sup inf £i[Yp\ = ViQ) = V{Q) > mi£^[V{T')] = mi£^[V{T')] 

pe5o.T*^^ peSo.T^'^^ 

> inf £4^r'] sup inf £t[Yp], 

thus ^[V^(t')] = inf — mf ^'i[^T'] = ^[Yr']- However, this may not imply that V{t') — Yr', a.s. since ^ 

does not satisfy strict monotonicity, which we have also seen in Example 16.11 (if V{t') were a.s. equal to Yr', for 
any i G I, applying (|4.14p to singleton {£i}, we would deduce from (I5.13P and Lemma [5751 that 

KVrv, = Vi^' A Tv) = V{t' a tv) = cssinf i?*(r' A ry) = es|inf (l{,,<,^jff (^') + i{r'>rv}R\rv)) 

= l{r'<Tv}eS|mf i?^'^') + l{T'>Tv}eS|mf i^'C^v) = l{r'<Tv}^('r') + l{r'>rv}^('rv) 
= l{,,<,,}T/(r') + l{,,>,,}V-(ry) = llr'<r,}ViT') + l{r'>r,.}Vl 
= '^{t'<tv}Yt' + 1{t'>tv}^V' ^ ^'Arv: a.s., 

which would further imply that Ty — t' A Ty, a.s., thus Ty < t' , a.s.) 
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7 Applications 



In this section, we take a c?-dimensional Brownian motion B on the probability space (£7, J^, P) and consider the 
Brownian filtration generated by it: 



F = { J"* = <7{Bs] s e [0, t]) V J^}f^^„ , where A/" collects ah P-nuh sets in T. 
We also let ^ denote the predictable cr-algebra with respect to F. 

7.1 Lipschitz (/-Expectations 

Suppose that a "generator" function g = g{t,uj,z) : [0, T] x SI x M*^ i-> M satisfies 
(i) g{t,uj,0) —0, dt X dP-a.s. 

(m) g is Lipschitz in z for some Kg > : it holds dt x dP-a.s. that 
\g{t,oj,zi)-g{t,tu,Z2)\<Kg\zi-Z2\, Vzi,Z2 eM''. 



(7.1) 



(7.2) 



For any ^ G L'^{J-t), it is well known from IPardoux and Pend |1990l | that the backward stochastic differential 
equation (BSDE) 

rt-e + ^ <?(s,e,)ds-^ BsdB,, te[0,T] (7.3) 

admits a unique solution (r«'f,e«'5) £ Cl(\0 , T]) x W|([0,T];R'') (for convenience, we will denote ([731) by 
BSDE(^,(/) in the sequel), based on which iPend 1997l | introduced the so-called "^-expectation" of ^ by 



t G [0,T]. 



(7.4) 



To show that the (/-expectation £g is an F-expectation with do main Dom(E a) = L^{Tt), we first note that 



L^{J-t) G !^t- The (strict) Comparison Theorem for BSDEs (see e.g. iPeng 19971 . Theorem 35.3]) then shows that 
(Al) holds for the family of operators J"t] : L'^{Tt) ^ L'^{Ft)] 
(r«.5,ef>9) to the BSDE(g,ff) implies that the family {£:g[-|J"t]} 



while the uniqueness of the solution 



tG[0,T] 

satisfies (A2)-(A4) (see e.g. iPend [2004 . 



Lemma 36.6] and lCoauet et al.l [20021 Lemma 2.1]). Therefore, Eg is an F-expectation with domain Dom{Eg) 

Moreover, the generator g characterizes Eg in the following ways: 
(1) If the generator g is convex (resp. concave) in z, i.e., it holds dt x dP-a,.s. that 

5(t,Azi + (l-A)z2)< (resp. >) A5(t,zi) + (l-A).g(i,Z2), VAe(0,l), Vzi,Z2GE^ (7.5) 
then £g[-]J^t] is a con vex (resp. concave) ope rat or on L^(JV) for any t e [0, T], thanks to the Comparison Theorem 



for BSDEs. (see e.g. IEI Karoui et al.l jl997[| or lPend |2004 Proposition 5.1]). 
(2) Let g be another generator satisfying (|7.2|) . If it holds dt x dP-a,.s. that 

g{t,z)>g{t,z), VzeM'^, 

the Comparison Theorem for BSDEs again implies that for any <^ e L?{Ft) and < G [0, T] 

Eg[S,\Tt]>Eg[£,\^tl a.s. 



(7.6) 



(3) g {t,uj,z) = ~'g{t,oj, ~z), {t.uj.z) G [0,T] x x also satisfies (|7.2p . Its corresponding (/-expectation Eg 
relates to Eg in that for any ^ G L?{J-t) and t G [0, T] 



Eg-[i\:Ft]^-Eg[-^\Ft], 



(7.7) 



(in fact, multiplying both sides of BSDE(— ^,(ji) by —1, we see that the pair ( — F 9 ^^^) solves the 

BSDE(^,.g-).) 

To show that the (^-expectation Eg satisfies (HO)- (113), we need two basic inequalities it satisfies. 
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Lemma 7.1. Let g be a generator satisfying ^7.2^ . 
(1) For any ^ G LP'{Ft), we have 



sup |fgK|J^t]| 

te[o,T] 



le?,9| 



where C is a universal constant independent of and g. 
(2) For any ji > Kg and ^,rj ^ L'^{Tt), it holds a.s. that 

\Eg[S,\Tt]^EMH\<£9A\^~ri\\Ttl V<e [0,T], 



where the generator g^ is defined by gfj,{z) = mI^I, z G R'^ . 

Proof: A simple application of Briand et al. 2000l Proposition 2.2] yields (1). On the other hand, (2) is a mere 
generalization of iPeng 2004 Proposition 3.7, inequality (60)] by taking into account the continuity of processes 
£g[C\T.] and for any ^ e L^{Tt). □ 



Proposition 7.1. Let g be a generator satisfying ^7.2^ . Then £g satisfies (H0)-(H3). 

Remark 7.1. Since £g[^\J-] is a continuous process for any ^ G L'^{J-t), we see from (|2.6p that £g[-\J-^] is just a 
restriction of £g[-\J^,y] to L^''^{J^t) = G L'^{J^t) '■ S, > c, a.s. for some c = c(^) G M} for any v G 5o,T- 

Thanks to Proposition 17. 11 all results on F-expectations £ and £ in Section [5] are applicable to ^-expectations. 
In the following example we deliver the promise we made in Remark 12.71 This example indicates that for some 
^-expectations, lim fg[^n] < oo is not a sufficient condition for lim ^„ £ Dom^ {£g) — L^'+(J^t) = G L^{Ft) '■ 
^ > 0, a.s.} given that {^n}neN is an a.s. convergent sequence in Doni^ {£g). 

Example 7.1. Consider a probability space ([0, 1], i^[0, 1], A), where A is the Lebesgue measure on [0,1]. We define 



a generator g{z) = —\z\, z G M''. For any n G N, it is clear that the random variable {^n(w) = uj 2 + n+2 1 
L'^'^{J-t) = Dom^{g). Provosition \2.2\ (2) then implies that 

= £M < £~g[Cn] = r«™^ - 6. " / \Qt^\ds - I et^dB, <(.n~ I Qt~'dB, 



A _i I ^ 



Taking the expected value of the above inequality yields that 



"'0 



- + — 

2 ' n+2 



< 2. 



(7.8) 



Since {^njnGN is an increasing sequence, we can deduce from (Al) and Ii7.8\ ) that < lim t^gKn] ^ 2. However, 

n^oo 

□ 



lim t^n = {i^ 2 ^ does not belong to L'^'^{Tt) = Dom^{g). 



Similar to Proposition 13. 1[ pasting two (/-expectations at any stopping time generates another (/-expectation. 

Proposition 7.2. Let gi, g2 be two generators satisfying \7.2^ with Lipschitz coefficients Ki and K2 respectively. 
For any v G 5o,Tj we define the pasting of £g-^,£g2 at v to be the following continuous F-adapted process 



^^92 Kl-^t] = i{.<t}^92 Kl-^t] + M.>t}£9^ K m^.] I-Ft] , Vi G [0, T] 

for any ^ G L'^{Ft)- Then £g_^ is exactly the g-expectation £g-^ with 

g''{t,uj,z) = l{j,(„)<t}52(t,t^, z) + l{^(„)>t}5i(t,a;,z), {t,uj,z) G [0,T] xQxR'^, 
which is a generator satisfying \7.2^ with the Lipschitz coefficient Ki V if 2- 



(7.9) 



(7.10) 
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Fix M > 0, we denote by the collection of all convex generators g satisfying (|7.2p with Lipschitz coefficient 
Kg < M. Proposition 17.21 shows that the family of convex ^-expectations S'm = {£g}ge'^M closed under the 
pasting (|7.9I) . To wit, S'm is a stable class of (/-expectations in the sense of Definition 13.21 In what follows we let 

^' be a non-empty subset of such that S' = {£g}g^t^i is closed under pasting. Now we make the following 
assumptions on the reward processes: 

Standing assumptions on the reward processes in this subsection. Let F be a continuous F-adapted 
process with 

C'y = fesssupFt)^ e L^iTr) (7.11) 

and satisfying (Y3). Moreover, for any 5 G 5^', we suppose that the model-dependent cumulative reward process is 
in the form of 



Hl^ f hids, Vte [0,T], 
Jo 



where {hf,t £ [0,T]}g^c^i is a family of predictable processes satisfying the following assumptions: 
(hi) There exists a c' < such that for any g e hf > c', dt x c?P-a.s. 

(/i2) The random variable u ^ h'{t,ijj)dt belongs to L'^{Ft) with h'{t,Lu) = fesssup/if (cj)] (the essential 

supremum is taken with respect to the product measure space ([0, T] x fi, ^,Xx P), where A denotes the Lebesgue 
measure on [0, T]). 

(h3) For any 1/ G Sq^t and gi, 52 G it holds for any < s < t < T that 

hf = l{,<t}hf + l{,>t}/if , dt X dP-a.s., 

where g'^ is defined in (|7.10p . 



Then the triple {S'^J^' = {H^^gfzcgi ^Y^ satisfies all the conditions stated in Section U] and [HI Thus we can 
carry out the optimal stopping theory developed for F-expectations to ((^", J^' , Y) as we will see next. 

Theorem 7.1. The stable class §' satisfies (|5.12p . the family of processes M" satisfies (SI') (thus (SI) see Remark 
\5.1]) . (S2) and (S3), while the process Y satisfies (Yl), (|4.6p [thus (Y2'), again by Remark \5.l\] and (Y3). Moreover, 

the family of processes |y/ = Yt + Hf, t G [0>2^]}ggg!/ '■s both "S" -uniformly-left-continuous" {thus satisfies (|5.2p . 
see also Remark \5.l\] and "S" -uniformly-right-continuous" . 

7.2 Existence of an Optimal Prior in (14.11) for (/-Expectations 

For certain collections of (/-expectations, we can even determine an optimal generator g*, i.e., we can find a generator 
g* such that 

£9* ] = sup £g [Y^ ] = sup £g [r/] , 
see (3,p)eex5o.T 



where the optimal stopping time t(0) is defined as in Theorem 14. II 

Let S" be a separable metric space with metric \ ■ \s such that S' is a countable union of non-empty compact 
subsets. We denote by 6 the Borel cr-algebra of S and take Hp([0,T];5) as the space of admissible control 
strategies. For any U £ ■Hp([0,T]; S), we define the generator 

g^{t,u,z)=g°{t,uj,z,Ut{uj)), (7.12) 
where the function g°{t, u>,z,u) : [0, T] x f2 x R'' x 5 M> R satisfies: 
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{g°l) g° is ^(g) ^{m.'^) (g) 6/^(]R)-measurable. 
{g°2) It holds dt x dP-a.s. that 

g°(t,cj,0,M) = 0, VueS. 

((7°3) g° is Lipschitz in z: For some Kq > 0, it holds dt x dP-a.s. that 

|g°(t, cj, zi, u) — w, Z2, m)| < -ftTol^i — 22I, Vzi,Z2SK'', Vugs'. 

((7°4) 5° is convex in z: It holds x dP-a.s. that 

g°(i,a;,Azi + (l-A)z2,?i) < A.g°(t,w,zi,u) + (l-A)5°(i,a;,Z2,u), VAg(0,1), Vzi,Z2GM'^, VueS. 

Now fix a non-empty subset il of 'Hp([0, T]; S") that preserves "pasting", i.e., for any e iSo,t and U^,U^ G it, 

c/.^H = i{,(„)<t}[/2H + i{,(„)>,}[/i(u;), (t,w)e[o,r]xf), (7.13) 

also belongs to it. Then it is easy to check that {£g^ }ueii C S'k^ forms a stable class of ^-expectations. 

Let Y still be a continuous F-adapted process satisfying (|7.1ip and (Y3). For any J7 G it, assume that the 
model dependent reward process has a density which is given by 

/if H ^ hit,L,,Ut{Lo)), [t.Lo) e [o,r] X 

where /i(t, w, u) : [0, T] x x 5* i— > M is a ^ (S/^(R)-measurable function satisfying the following assumptions: 
(h\) For some c < 0, it holds dt x rfP-a.s. that h{t, uj,u) > c for any u G S". 

{h2) The random variable w h{t,oj)dt belongs to L'^{Ft) with h{t,u) = (esssup /if (w)^ (the essential 

supremum is taken with respect to the product measure space ([0, T] x fi, A x P), where A denotes the Lebesgue 
measure on [0, P]). 

It is easy to see that {/if, t G [0, T]}u^u is a family of predictable processes satisfying (hl)-{h3). Hence, we can 
apply the optimal stopping theory developed for F-expectations to the triple (^{£g^}ij^ii, {h^}iJeUiY) thanks to 
Theorem 17. II Now let us construct a so-called Hamiltonian function 



H{t, oj, z, u) = g°{t, ui, z, u) + h(t, cj, u ), {t,uj,z,u) e[0,T]xnxR'^ X S. 
We assume that for any (t, cu, z) G [0, T] x 51 x M.'^, there exists a. u — u*{t, oj, z) E S such that 

supi?(/, uj,z,u) — H(t,uj,z,u*{t,uj,z)). (7-14) 



sr 

ues 



(This is valid, for example , when the m etric space S i s compact an d the mapping u ^ H{t,uj, z,u) is continuous.) 
Then it can be shown (see BenesI 1970 . Lemma 1] or lElliottI |l982L Lemma 16.34]) that the mapping u* : [0,T] x 



n X R''- S can be selected to be ^ (g) ^(M'')/6-measurable. 

The following theorem is the main result of this subsection. 
Theorem 7.2. There exists a J7* G it such that 

sup £g^[Y^^]=£g^,[Y,%^], 

(C/,p)GUx5o.T 

where the stopping time t(0) is as in Theorem \4 t\ 
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7.3 The Cooperative Game of Karatzas and Zamfirescu [2006] Revisited 



In thi s subsection, we apply the results of the last subsection to extend the results of iKaratzas and Zamfirescu 
2006( . Let us first recall their setting: 



• Consider the canonical space = (C([0, T]; M''), ^(C([0, T]; M''))) endowed with Wiener measure P, under 

which the coordinate mapping process B{t,uj) = Lo{t), t e [0,T] becomes a standard d-dimensional Brownian 
motion. We still take the filtration F generated by the Brownian motion B (see (|7.1[) ) and let ^ denote the 
predictable cr-algebra with respect to F. 



• It is well-known (see e.g. lEUiottl 19821 Theorem 14.6]) that given a a; G M"*, there exists a pathwise unique, strong 
solution X{-) of the stochastic equation 



X{t)=x+ j a{s,X)dBs, ie[o,r], 

JO 



where the diffusion term cr(t, w) is a R -valued predictable process satisfying: 
(crl) /J" |cr(i, 0)pdi < oo and cr(t,w) is nonsingular for any (i,w) G [0,r] x VL. 
((t2) There exists a. K > Q such that for any w, w G and t G [0, T] 

\\<7^'^{t,uj)\\< K and \aij{t,oj) - <j,j{t,Zj)\ < K\\uj -uWl, yi<i,j<n 

with \\uj\\l = sup |w(s)|. 

se[o,t] 

• Let f{t, uj,u) : [0,T] X n X S ^ is a ,^ <S> 6/^(M'')-measurable function such that 

(i) For any u G 5, the mapping {t,uj) i-^ f{t,uj,u) is predictable (i.e. ,^-measurable) ; 

(ii) With the same K as in (|7.15p . 

\f{t,Lo,u)\ < K{1 + M;), y{t,u:,u) e[0,T]xnx s. 
For any [/ G il = TLpdO, T]; 5), Karatzas and Zamfirescu 20061 page 166] shows that 



(7.15) 



(7.16) 



dPu A 
'dP 



= exp|^ {a-\t,X)f{t,X,Ut),dBt)-^J^ \cT'\t, X)fit, X,Ut)\^ dtj , 



defines a probability measure Pjj 



The objective of IKaratzas and Zamfirescul 2006l | is to find an optimal stopping time t* G 5o,t and an optimal 
control strategy U* € il that maximizes the expected reward 



^{X{p)) + / h{s,X,Us)di 



Eu 



over (p, U) G iSo,T x il. Here (/3 : K is a bounded continuous function, and h{t, uj,u) : [0,T] x fl x S ^ M. is 

a ^ (g) (3/^(K)-measurablc function such that \h{t,uj,u)\ < K for any {t,uj,u) G [0,T] x ft x S (with the same K 
that appears in (|7.15p ). 

Corollary 8 of Karatzas and Zamfirescu 200(^ shows that under (|7.16p , the process 



A 



Z(t) — esssup Eu 

(;7,p)Gilx5t,T 



(p{X{p)) + / h{s,X,Us)di 



iG [0,T] 



admits an RCLL modification Z", and the first time processes Z" and {</j(X(t)) j^^j^ meet with each other, i.e. 



t(0) = inf \t G [0,T] I Z° = <y9(X(t))}, is an optimal stopping time. That is. 



sup Eu 

(C/,p)eltx5o,T 



^{X{p)) + / h{s,X,Us)di 



supi?c/ 

C/6U 



^(0) 



(^(X(t(0))) + / h{s,X,U,)ds 



(7.17) 
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Moreover, if for any {t,u,z) e [0,T] x ft x R"*, there is a u*{t,uj,z) e S which is ^ (g) ^(M'')/6-measurable 
such that 



sup H{t, uj, z, u) — H(t, (jj, z, u*{t, uj, z)) 



(7.18) 



with H{t,u!,z,u) = (a ^{t,oj)f{t,uj,u), z) + h{t,uj,u), {t,u},z,u) g [0,T ] xflxW^ x S, then there further exists 
an optimal control strategy U* G il (see Karatzas and Zamfirescu 20061 Section 8]) such that 



sup Eu 

{u,p)eUxSo,T 



'Mp)) 



h{s,X,Us)ds 



— Etj* 



r(0) 



h{s,X,U*)ds 



(7.19) 



In the main result of this subsection, we will show that the assumption of iKaratzas and Zamfirescul 2006l | that 
ip and h are bounded from above by constants can be relaxed and replaced by linear-growth conditions. This comes, 
however, at the cost of strengthening the assumption stated in ()7.16p . 

Proposition 7.3. With the same K as in (|7.15l) . we assume that 

- K < ip{x) < K\xl Va;eR'^ (7.20) 

and that for a.e. t e [0,T] 

\f{t,uj,u)\ <K and ~ K < h{t,u},u) < K\\uj\\*t, V (w, w) G f7 x S". (7.21) 

Then the process {^i^)} ^^^q x] ^ RCLL modification , and the first time t(0) when the process meets the 
process |(/?(X(t)) j^^j^^ is an optimal stopping time; i.e., it satisfies (j7.17p . Moreover, if there exists a measurable 

mapping u * ■.[Q,T]xnxW^ ^ S satisfying ((TTSI) . then th ere exists an optimal control strategy [/* G it such that 
([7191) holds. 



7.4 Quadratic (^-Expectations 

Now we consider a quadratic generator g = g{t, uj, z) : [0, T] x 51 x K'^ M> K that satisfies 

' {i) g{t,uj,Q) = 0, dtx dP-n.s. 
(ii) For some k > 0, it holds dt x dP-a.s. that 

ff(i,w,z)| < k(1 + |z|), yzeR''. 

(Hi) g is convex in z in the sense of (j7.5p . 

Note that under (ii), (i) is equivalent to the following statement: It holds dt x dP-a.s. that 

|g(t,tj,z)| < k(|z| + i|z|2), yzeW'-. 

In fact, it is clear that ()7.23p implies (i). Conversely, for dt x dP-a.s. {t,uj) e [0,r] x 51, one can deduce that for 
any z G 



(7.22) 



(7.23) 



\g{t,uj,z)\ 



'lit,u:,z)-gi t,Lo,0)\ ^ \ ^{t, Xz)zdX\ < k {I + X\z\)\z\dX = k{\z\ + ^\z\^) . 

For any ^ G L'^{Ft), Briand and Hu 20081 Corollary 6] (where we take f — g, thus a{t) = -I and (/3, 7) = (0, 2k)) 
shows that the quadratic BSDE(C,5) admits a unique solution (r«'ff,e«'9) G C^([0,r]) x AfF([0, T]; R'^). Hence 
we can correspondingly define the "quadratic" ^-expectation of ^ by 

fgKI-F,]^rp, tG[o,T]. 

To show that the quadratic ^-expectation £g is an F-expectation with domain Dom{£g) = L^^Ft), we first note 
that L^^Ft) e (Clearly, L^(J"t) satisfies (Dl) and (D3) and R C L'=(Jt)- For any ^,7; G £^(J't), A £ Ft and 
A > 0, we have E[e^\'^'^^\] < E[e^\^\] < 00 and E[e^^^+i\] < i;[e^l«le^l''i] < ^E[e^^^^\] + ^E[e^^^''^] < 00, thus 
(D2) also holds for L'^{Ft)). Similar to the Lipschitz ^-expectation case, the uniqueness of the solution (r«'9,e«^9) 
to the quadrat ic BSDE(g, g) implies that th e family of operator s {£g[-\Ft] : L'^{Ft) (^^)} telo t] satisfies 



(A2)-(A4) (cf. iPengj |2004 Lemma 36.6 ] and Coquet et al.l [20021 Lemma 2.1]), while a comparison theorem for 
quadratic BSDEs (see e.g. iBriand and H u 2008 . Theorem 5]) and the following proposition show that (Al) also 
holds for the family {£g[-\Ft]} ^^^^ 
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Proposition 7.4. Let g he a quadratic generator satisfying (|7.22p . For any i^^,^^ G LP{J-'t), if > S,'^, a.s., then 
it holds a.s. that 



Vi e [0,T]. 



Moreover, if T^i^s = T^^'S, a.s. for some V e iSo,T; then 

e = e, a.s. 



(7.24) 



(7.25) 



Therefore, the quadratic ^-expectation £g is an F-expectation with domain Dom{£g) — LP(J-t). Similar to 
the Lipschitz g - expec tation case, the convexity (|7.22p (iii) of the quadratic generator g as well as Theorem 5 of 
Briand and Hu 2008l | determine that fg[-|J^t] is a convex operator on LP(Tt) for any t G [0,T]. Hence, £g satisfies 
(HO) thanks to Lemma [3Tl To see £g also satisfying (H1)-(H3), we need the following stability result. 

Lemma 7.2. If £_n a.s. and E[e^\i\] sup£'[e^l«"l] < oo for any A > 0, then 



lim E 



sup 

■te[Q,T] 



= 0. 



£g[Cn\J^t] — £g[£,\J-t] 

Proof: Taking /„ = g and f — g in Proposition 7 of Briand and Hu 200^ yields that 

expip sup £g[Cn\J^t] - £g[^\J^t] \ 
^ telQ.T] 



(7.26) 



lim E 



= 0, Vp>l. 



Then ILMI) follows since £; sup £g[£,n\J't]-£g[£.\^t\ 



<E 



cxpj sup £g[^n\J^t]-£g{^\J^t] \ for any n 6 N. □ 



Proposition 7.5. Let g be a quadratic generator satisfying ()7.22p . Then the quadratic g-expectation £g satisfies 
(H0)-(H3). 

Similar to Remark m| since £'§[^1^'.] is a continuous process for any ^ G L'^^Tt), we see from (|2.6p that 

is just a restriction of to L'^''^{Tt) = & L^^Tt) '■ ^ > c, a.s. for some c G R} for any z/ G So,t. Therefore, 

all results on F-expectations £ and £ in Section [2] work for quadratic ^-expectations. 

The next result, which shows the existence of an optimal stopping time for a quadratic (7-expectation, is the 
main result of this subsection. 

Theorem 7.3. Let g be a quadratic generator satisfying (|7.22l) . For any right- continuous F -adapted process Y 



with C.Y — (esssupyt) G L'^{J-t) and satisfying (Y3), we have 

sup £g[rp] ^fgir^fo)], 

where t(0) is as in Theorem 



8 Proofs 

8.1 Proofs of Section H 

Proof of Proposition [2711 For any f G A and t G [0, T], let us define £[(^|J^t] = ^t. We will check that the system 
[^|7^t], ^ G Ajj^jpyj satisfies (A1)-(A4); thus it is an F-expectation with domain A. 

1) For any 77 G A with C < a-S-, we set A = {£[^\Tt] > £[?/|J't]} G J"t, thus lA£[i\J^t] > 1^^ [??|-7^t]- It follows 
from (al) and (a2) that 

£°[lA£[^\J't]] >£''[lA£[v\J't]] >£°M = ^°[lAfKI-^t]], 
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which shows that 5° [l^f | J't]] = £° [l^^ ['7|-^t]] ■ Then the "strict monotonicity" of (al) further imphes that 
lAf Kl-^t] = USMJ^t], a.s., thus P{A) = 0, i.e., £[^\Tt] < £[v\J^t], a.s. 

Moreover, ii < £, < 7], a.s. and J"o] = i?[?7|^o], applying (a2) with A — fl and 7 = 0, we obtain 

Then the strict monotonicity of (al) imphes that ^ = ry, a.s., proving (Al). 

2) Let < s < < < r, for any A G J-'s C J-j and 7 G C At, one can deduce that 

£''[lA£[£[^\J't]\J's] +7] =f°[lAfK|-Ft]+7] =f°[lAe + 7]- 

Since £[f [e|-Ft]|-F,] G J^s, (a2) imphes that £[^\Ts] = = £ [^Kl-^t] |-^.] , proving (A2). 

3) Fix A E Tt, for any A E J-'t and 7 G A(, we have 

£" [l^{lA£mTt]) +7]=£° [linA^KI-^t] + 7] - f° [l^n^e + 7] - f° [1^(1^0 + 7] ■ 
Since lA£[C\J't] e Tt, (a2) imphes that £[lAC\J^t] = lA£[^\J^t], proving (A3). 

4) For any A E Tt and 77, 7 G At, (D2) imphes that IaV + 7 G At, thus we have 

£° [umTt] + v) + !]=£" [U£[m + (Iav + 7)] = £" [U^ + (Uv + 7)] = [iA(e + v) + 1] ■ 

Then it foUows from (a2) that £[^ + r]\J't] = £[i\J't] + V, proving (A4). □ 

Proof of Proposition [2T2l (1) For any A G J-t, using (A3) twice, we obtain 

£[lA^+lA^7j\J^t] = lAf[lAe+lA=r;|J-t] + lAc£[lAe+lA=?7l-^i]=^[lA(lAe+lA=??)l-^t]+^[lA=(lAC+lAc?7)l-^t] 
= £[lAi\Tt] + £[lA^v\^t] = lA£[C\^t] + lA=£[77l^t], a.s. 

(2) Applying (A3) with a nuU set A and ^ = 0, we obtain £[0\J't] = £[1^01 J"t] = Ia^ [0|-Ft] = 0, a.s. If C G Domt{£), 
(A4) implies that £[^\J't] = £[0 + C| J"t] = £[0\J^t] + C = a.s. 

(3) It £, < T], a.s., (Al) directly implies that for any A G J^i/, ^ ^[lyi??]. On the other hand, suppose that 
f < £ [lyiTy] for any A G J^u- We set A ^ > rj} e T^, thus 1^^ > 1^77 > c A 0, a.s. Using (Al) we see that 
£[1a^] > f [1^7?]; hence £[1^.^] = £[1aV]- Then (A4) implies that 

£[1^^ - c A 0] = £[1^£,] - c A = £[1aV] - c a = £:[1^77 - c A 0]. 

Applying the second part of (Al), we obtain that 1^^ — c A = 1^77 — c A 0, a.s., which implies that P{A) — 0, i.e. 
^ < 77, a.s. □ 

Proof of Proposition [273t We shall only consider the £-supermartingale case, as the other cases can be deduced 
similarly. We first show that for any s G [0, T] and i' G SQrp 

£[X,\Ts]<X,^s, a.s. (8.1) 
To see this, we note that since {t^ < s} G Ts, (A3) and Proposition 12.21 (2) imply that 

£[x,\j^s] = i{,>s}£[x,\J^s] + i{.<s}£[x,\Ts]^£[i 

— 'i-{v>s}£[X,^Vs\j's] + 'i-{u<s}£[Xiy/\s\j^s] ~ 'i-{u>s}£[X,jVs\j's] + 'i-{u<s}XuAs, a.s. (8.2) 

Suppose that 7/^ = V s takes values in a finite subset {ii < • • • < t„} of [s, T]. Then (A4) implies that 
£[A^JJ"t„_i] ^ £[l{^^=t„}Xt„\Tt„_j^] +^l{i,^=ti}Xti, a.s. 
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Since {vs — tn} = {i^s > tn-i} e ^t„-n (A-3) shows that 

n-2 

Thus it holds a.s. that £[Xi.j7^t,^_ J < ls^^^yt,i^2}^tr,-i + ^ '^{p,=ti}Xti- Applying f [-l^tn-a] both sides, we 

i=l 

can further deduce from (A2)-(A4) that 

n-2 



i=l 

n— 2 n— 3 



i=l i=l 

Inductively, it follows that £[Xu^\Fti] < Xt^, a.s. Applying (A2) once again, we obtain 

£[X,^\T,] ^ £\£[X,^\Tt,]\T)^ < £[Xt,\Ts] < X,, a.s., 
which together with (|8.2p implies that 

£[X^\Ts] < l{u>s}Xs + l{u<s}Xi,As = X^As, a.s., proving (|5?T|) . 
Let cr G 5(f7' taking values in a finite set {si < • • • < s^}, then 

m m 

Proof of Proposition [2741 Given ^ g Dom{£), we let e 5^^, take values in a finite set {ti < ■ ■ ■ < i„}. 

1) For any r/ £ Do'm{£) with ^ < rj, a.s., (Al) implies that 

n n 

•^Kl-^i^] = X! l{i'=t,}^KI-^t>] ^ X! l{i'=t,}^['?l-^t>] = £[v\^i^], a.s. 

i=l 4=1 

Moreover, if < ^ < 77, a.s. and £[^|Jv] = £[i]\Ta], a.s. for some a £ Sqj^, we can apply Corollary 12. ll to obtain 

£[^] ^ £[£[C\T,]] =£[£MT„]] ^£M. 
The second part of (Al) then implies that ^ = r/, a.s., proving (1). 

2) For any A e 7>, it is clear that Ari{i^ = ti} G J'tt for each i G {1, • • • , n}. Hence we can deduce from (A3) that 

n n n 

£[1a^\J'.] = ^l{,=t,}f[lAe|-^tJ - ;^f[l{.=t,}nAei-^tJ =J2lir.^u}nAmJ'u] 

i—1 i—1 i—1 

71 

= l{z.=ti}fK|-7^tJ = Ia'^KI-T^i.], a.s., proving (2). 

1=1 

3) For any 77 G Domi,{£), since l^^=ti}il £ Domt^{£) for each i G {1, ■ • • ,n}, (A3) and (A4) imply that 

n Ti n 

i—1 i—1 i—1 

n 

= Y'^{u=u}£[i\^u]+V = a.s., proving (3). 
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The proof of (4) and (5) is similar to that of Proposition !^^ (1) and (2) by applying the just obtained "Zero-one 
Law" and "Translation Invariance" . □ 

Proof of Theorem 12. It (HI) is an easy consequence of the lower semi-continuity (j2.2p . In fact, for any ^ G 
Dom^{£) and any {An}neN C Tt with lim tlA„ = 1 a-S., {lyt^i^jngN is an increasing sequence converging to 
Then applying the lower semi-continuity with — and using (Al), we obtain £[£] < lim ti?[lA„C] ^ so 
(HI) follows. 

On the other hand, to show that (HI) implies the lower semi- continuity, we first extend (HI) as follows: For 
any ^ G Dom "*"(£) and any {A„}„gN C J-t with lim tlyi„ = Ij a-S-, it holds for any t G [0,T] that 

\im t£[lAMJ't]^mJ't], a.s. (8.3) 

n— >oo 

In fact, by (Al), it holds a.s. that {'^^[lyi„'^|-^t]}„gpj is an increasing sequence bounded from above by f 
Hence, lim t^^[lA„Cl-^t] < ^Kl-^t]: a.s. Assuming that hm t^^[lA„CI-^t] < '^Kl-^t] with a positive probability, we 

n— >C30 n^oo 

can find an e > such that the set = \ lim t^[lA„CI-^t] ^ ^[^l-^t] ~ e| ^ J^t still has positive probability. 
Hence for any n € N, we have 

UAUJlJ^t] < lim tS[UJ\J^t] < lA,{£[^\Tt]-e), a.s. 

n— >-oo 

Then (Al)-(A4) imply that 

£[1a1aM+^ = S[UlAj + e]=£[£[lAlAj + e\Tt]] ^ £[lAAUJ\J't] + e] 
< £[lAM^\^t] + elAi] ^£[£[lAA + £^A^JJ't]] =£[lA,e + elAj]. 

Using (A4), (HI) and (Al), we obtain 

£[1aA + £]=^[^aM+£= limtf[lA„lA,e]+£<^[lA,e + £lAj] <^[lA,e + £], 

thus £[1a,£, +£] — £['i-A,£, + sIa-:]- Then the second part of (Al) implies that Ia^C + £ = Ia^C + elA<:, a.s., which 
can hold only if P{Ai.) = 0. This results in a contradiction. Thus lim [l^^^jj^t] — £[£^\Tt], a.s., proving (|8.3I) . 

Next, we show that (12. 2p holds for each deterministic stopping time v = t ^ [0, T]. For any j, n e N, we define 
Ai = n^„{|^ - 61 < l/i} e ^T- (Al) and (A4) imply that for any fc > n 

^['^Al^\H < £[l{|5-?.|<i/j}^l-^*] < £[^k + l/j\Tt] = £[^k\Tt] + l/j, a.s. 

Hence, except on a null set N^^, the above inequality holds for any k > n. As A: cxd, it holds on {N^Y that 

Si^Ai^lJ^t] < lun£[6|^t] + l/j. 

(Here it is not necessary that lim £[6|J^t] < cxd, a.s.) Since ^ — > ^, a.s. as n oo, it is clear that limtl^ij — 1, 

a.s. Then jO]) implies that £[^\Tt] = lim t'^il^J ^l-^t] holds except on a nuh set NL Let ^ U^^qN^. It then 
holds on (N^y that 

£[^\Tt] - lim t£[l^. el-^t] < lim £[^k\J't] + l/j- 

As J — > OO, it holds except on the null set UJ^^N^ that 

£[£.\:Ft\ < Ijm £[UJ't]- (8.4) 

Let u € S^rp taking values in a finite set {^i < • • • < tn}. Then we can deduce from f|8.4p that 

n 71 n 

m^^] = M'^=U}£[(\:Ft,] < J2 lis ^iUJ'u] = lim 5Z l{-=t,}^Knl-^*J = 1™ ^[61-^.], a-S-, (8.5) 

2 — 1 2 — 1 z— 1 
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which completes the proof. □ 

Proof of Theorem 12. 2t We first show an extension of (H2): For any £,,r] € Dom~^{£) and any {A„}„gN C J-t 
with lim 4,lyi„ — 0, a.s., it holds a.s. that 

limi£[^ + lA,MJ't]^mJ't], a.s. (8.6) 

n—^oo 

In fact, by (Al), it holds a.s. that + l^^r/jJ'tJl^^j^ is a decreasing sequence bounded from below by 
Hence, lim [^ + l^^y^lJ^t] > 5[i^|J't], a.s. Assume that hm I + ! A„ri\Tt] > £[^\J-t] with a positive probability, 
then we can find an e > such that the set A'^ — { lim i£[£, + lA^vl-^t] > ^[Cl-^t] + G -^i still has positive 

n— foo 

probability. For any n £ N, (A4) implies that 

Applying (A1)-(A3), we obtain 

£[1a'^^ + 1a,1a'J]] = £[£[lA',^ + lA,lA'^v\J't]] ^£[lA'M + lA„v\J't]] > £[1a'/[^ + e\J^t]] 
= £[£[lA'SC + sm]^£[lA^^{^ + e)]. 

Thanks to (H2) we further have 

£[1a'^^]= \imi£[lA'^^ + lA„lA'^v]>£[i-A'S^ + e)] >£[1a'^C], 

thus ^[lyi^^] = £[1a'^{^ + £)] ■ Then the second part of (Al) implies that P{A'^) — 0, which yields a contradiction. 
Therefore, lim 4,f + lA„?7|.Ft] — £[S,\Ft], a.s., proving (18. 6p . 



Since the sequence {^n}neN is bounded above by 77, it holds a.s. that ^ = lim < 77, thus (D3) implies that 

n— f 00 

^ £ Dom{£). Then Fatou's Lemma (Theorem 12. ip implies that for any v G S^j.^ 

< ]m£[U^ul a.s. (8.7) 

On the other hand, we first fix i e [0, T]. For any j, n eN, define = n^„{|^ - < e J^t- Then one can 
deduce that for any k > n 

£[ik\Tt] < £[iAiii + ^/j) + \Airv\^t] < £[^ + i/j + \Airiv ~ Ol^tl a.s. 

Hence, except on a null set N^, the above inequality holds for any k > n. As A; cxd, it holds on {N^^ that 



k 



hm f [CfclJ-*] < £[e + i/j + i^Airiv - 01-^*] 



Since ^ € LP{Tt) and ^„ ^, a.s. as n —J' 00, it is clear that limfl^j = 1, a.s. Then (|8.6p and (A4) imply that 
except on a null set , we have 

lim l£[^ + 1/j + 1,^. ..(,y - Ol^t] - + - f Kl-^t] + l/j- 

Let iV^' = U^^qNI, thus it holds on (N^)" that 

Ii^f[&|-Ft] <f[e|J-t] + l/i. 

/c-- f 00 

As j — > CX3, it holds except on the null set U°^n A^^ that lim f [^njj't] < f Then for any ly £ >5(fr, using an 

argument similar to ()8.5p . we can deduce that 

lim £[S_n\Tu] < a.s.. 
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which together with (|8.7p proves the theorem. 



□ 



Proof of Theorem 12. 3t Let F ~ {ti < t2 < ■ ■ ■ < td} be any finite subset of T>t- For j = 1, • • • ,d, we define 

d 



Aj — {vj < T} G Fy- , clearly, Aj D ^j+i • Let d' — — J , one can deduce that U f (a, = lA2j a-nd that 

3 = 1 



Since Xt G Dom{S) and L°°[Tt) C Dom{S) (by Lemma [^?T|) . we can deduce from (D2) that 

d' 

(&-a)C/F(a,&;X) -(a-XT)+ =^lA2,(&-a) + l{Xr<a}(^T-a) ei?om(5). 
Then Proposition 12.41 flVf3') and Proposition 12.31 imply that 

d' 

£[{b - a)UF{a, b;X) - (a - Xt)+\T.,,,] < {b - a)J2 1^2, + £[1^.'_^^a^^_^\a^^^{Xt - a)| J".,,,] 



Applying J to the above inequality, using Proposition 12.41 (l)-f3) and Proposition 12.31 once again, we 

obtain 



£[{b - a)UF{a,b;X) -{a- Xt)+\J',,„_,] 

d'-l 

< £\ 

d'-l 



{b~a)J2 1^2, + (1a2,,_i + lu^t-i(A,^_,\A2,)) ' 

d'-l 

i=l 

d'-l 

= (6-«)E1^2.+(1A2„_,+ V-l(^,^. ,\^,^.))(^[^.2j-^^2.'-J-«) 
i = l 

d'-l 
d'-l 

< 1a2, + lu,t-l^(^2,-l\A2,)(^-2.'-l - «)' 



where we used the fact that X^^^, > b on A2d' in the first inequality and the fact that X„^^,__^ < a on A2d'-i in 
the last inequality. Similarly, applying ^[•|-^i'2d'_2] above inequality yields that 



i'-l 



£[ib-a)UF{a,b;X) - (a ^ Xt)+\T.^„J < (b - a) i^^^. + _ a), a.s. 

Iteratively applying ^^[•|-^i/2^,_3], '^[■|-^i>2d'-4] ^^'^ eventually obtain that 

£ [{b - a)UF (a, 6; X)-{a- Xt)+] < 0. (8.8) 

We assume first that Xt > c, a.s. for some c G R. Since (a — < \a\ + |c|, it directly follows from (A4) that 

> £[{b-a)UF{a,b;X) - (a - Xt)+] > £[ib - a)UF{a,b; X)] - (|a| + |c|). (8.9) 
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Let {i^„}„eN be an increasing sequence of finite subsets of Vt with U„gN^ri — T^t, thus lim '\-UF„{a,b;X) 
UT>^{a,b;X). Fix M e N, we see that 



lim t l{(7F„(a,b;X)>M} — 1u„{C/f„ (a,b;^)>M} — '^{UT,^{a,b;X)> M] ■ 



(8.10) 



For any n e N, we know from (|8.9p that £[{b - a)A/ljj/^^ (a.fc;X)>Af}] < ^[{b ~ o.)UF^io;b; X)] < \a\ + |c|, thus 
Fatou's Lemma (Theorem 12. ip implies that 

£:[(6-a)Ml|c/^^(„_fc.x)=oo}] < S[{b- a)Ml^u^_^(^a.b:X)>M}] 

< \imt£[{b-a)Ml^u^^^,.b;X)>M}] <\a\ + \c\. (8.11) 

On the other hand, if £[■] is concave, then we can deduce from (|8.8p that 

> £[{b~a)UF{a,b;X) - {a - Xt)+] > ^£[2{b ~ a)UF{a,b; X)] + ^£[^ 2{a - Xt)+]. 
Mimicking the arguments in (I8.10p and (|8.1ip . we obtain that 

£[{b - a)2Ml[u^^^,^,.^x)=oo}] < [ - 2(a - Xt)+]. 

where -2(a - Xt)^ = l[XT<a}2iXT - a) G Dom{£) thanks to (D2). Also note that (Al) and Proposition [231 (5) 
imply that £[ - 2(a - Xt)+] < £[0] = 0. 

Using (HO) in both cas es above yields that P(j7-p^ (a, 6: X) = oo) — 0, i.e., 1/15^,(0, 6; X) < 00, a.s. Then a 
classical argument (see e.g. iKaratzas and Shrevd 199ll Proposition 1.3.14]) shows that 

PIboth lim Xs and lim Xs exist for any i £ [0, Tl ) =1. 



This completes the proof. 

Proof of Proposition 12. 5t We can deduce from ()2.4p that except on a null set N 



□ 



X^ — lim X^-(j.-^ < esssupXs and X^ — lim X^+f^,^ < esssupX^ for any t e [0,r], (8.12) 



thus X^ = lim X^-^^-^ < esssupX^ and X^ = lim -^f^+f^-) < esssupX^ for any £ S( 



■>0,T- 



(8.13) 



Proof of (1): Case I. For any v G iSo,t, if esssupX^ G Dorn^{£), (D3) and (|8.13l) directly imply that both X^ and 
X+ belong to Dom{£). 

Case IL Assume that £ satisfies (j2.5p . For any n G N, since X is an f-supermartingale and since q^i^)^ itii^) ^ 



Sqj., Corollary [2T] and Proposition 12.31 implv that 

Hence, }„gpj is an increasing non-negative sequence and }„gN i^ a decreasing non-negative 

sequence, both of which are bounded from above by Xq G [0,oo). (12. 5p and (I8.13P then imply that both and 
X+ belong to Dom{£), proving statement (1). 

Proof of (2): Now suppose that X+ G Dom+{£) for any t G [0,T]. First, we shah show that for t G [0,T] and 



5.14) 
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Since the distribution function x H> P{X^ < x} jumps up at most on a countable subset S of [0, oo), we can find 
a sequence {Kj}°^-^ C [0, oo)\S increasing to oo. Fix m,j e N, (A1)-(A3) imply that for any n > m 



Since Kj ^ S, P{X^ = Kj} = 0, one can easily deduce from (|8.12p that lim l^x +j .<Kj} = ^{x^<Kj}' ^-^^ {^""^ 
fact, for almost every uj G {X^^ < Kj} (resp. {X^^ > Kj}), there exists an N{uj) e N such that X^+^^^ < (resp. > 
) Kj for any n > N{uj), which means lim l^x + <Kj}{^) — l(resp. 0) = I^^+^k }(^)) ■ ^PPlyi^S the Dominated 
Convergence Theorem (Theorem 12. 2p twice, we obtain 

Since limtl|^+^^ j = 1, a.s., the Dominated Convergence Theorem again implies that 

£[UX+]^ \ira^£[lAl^x^^K,}X+] >lim£[lAl^xt<K,}X,Ut)]-£[^AX^Ut)]^ 

which leads to that ^fl^Xj^l > lim Fatou's Lemma (Theorem 12. ip gives the reverse inequality, 

thus proving (|8.14p . Since X is an 5-supermartingale, using (|8.14p . (A2) and (A3), we obtain 

for any A G J^j, which further implies that X^^ < Xt, a.s. thanks to Proposition 12.21 (3). 

Next, we show that X^ is an 5-supermartingale: For any < s < t < T, it is clear that Qnis) < 9,t(0 fo'" 
n G N. For any A e Tg, (A3) and Corollary 12.11 imply that for any n G N 



As rn- cx), (A2) and (A3) imply that 

£[1aX+]^ lm^£[lAX^^^^^] > Jimf[lAX^+(,)] = £[1aX+] = £[£[1aX+\J^s]] ^ £[1a£[X+\:Fs]]. 

Then Proposition 12.21 (3) implies that X^ > £[Xf^\J^s], a-S., thus {ATj^l^g^o.T] is an RCLL £-supermartingale. 
Proof of (3): li t ^ ^[Xt] is right continuous, for any t G [0,T], (|8.14p implies that 

£:[X+]= limf[X+(,)] 

Then the second part of (Al) imply that X^ = Xt, a.s., which means that X+ is an RCLL modification of X. On 
the other hand, if X is a right-continuous modification of X, we see from (|2.4p that except on a null set N 



a:, = lim a:„ 



= Xt, and X^+(t) = -'^o+i'tl for any n G N 



Putting them together, it holds on N"^' that 



x: 



lim X + , . 



9,t(t) 



.15) 



Since X is an £-supermartingale, (A2) implies that for any < ii < i2 < 7", £^[XtJ > £ [^[Xtj IJ^tJ] = ^[Xtj], 
which shows that the function t H> £[Xt\ is decreasing. Then (|8.14p and (|8.15p imply that for any t G [0,T] 

£[Xt] > lim£[X,] = lim £[X^+,J = £[X+] = £[Xtl 
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thus lim£[Xs] — £[Xt], i.e., the function 1 1-> £[Xt] is right continuous. □ 

Proof of Corollary 12.21 : Since essinf > c, a.s., we can deduce from (A4) that X"^ = {Xt — c}tg[o,T] is a 
non-negative £-supermartingale. If esssupXf G Donv^{£) ((D2) implies that esssupXt e Dom^{£) is equivalent 
to esssupXf'^ G Dom^{£)) or if (|2.5p holds, Proposition l2.5l (1) shows that for any v G 5o,t, both (^^)^ and 
belong to Dom^{£). Because 

(X"),-=X,--c and (X'^);^ = X+ - c, ViG[0,r], (8.16) 

(D2) and the non-negativity of {X'^)^ , {X'^)^ imply that 

X- = {X")- + c G Dom*{£) and X+ = + c G Dom*{£). 

On the other hand, if X^ G Dom^{£) for any i G [0,r], (D2) implies that the non-negative random variable 
= X+ - c belongs to Dom+{£). Hence, Proposition[22] (2) show that is an RCLL f-supermartingale 

such that for any t G [0,T], < Xf, a.s. Then ^AE^i, (E^ and (A4) imply that X+ is an RCLL £- 

supermartingale such that for any t G [0,T], X^ < Xt, a.s. Moreover, ii t i-^ £[^t] is a right-continuous function 
(which is equivalent to the right continuity of i i-> £[Xf]), then we know from Proposition 12.51 (2) that for any 
t G [0,T], {X'^)^ = X^, a.s., or equivalently, X^ = Xt, a.s. Conversely, if X has a right-continuous modification, 
so does X'^, then Proposition 12.51 (2) once again shows that t i-^ £[Xt] is right continuous, which is equivalent to 
the right continuity of t £[Xt]. This completes the proof. □ 

Proof of Theorem I2.4t We shall only consider the £-supermartingale case, as the other cases can be deduced 
easily by similar arguments. Fix t G [0, T], we let {t^^jneN be a decreasing sequence in SFrp such that lim i^^^ — v\/t. 
Since essinf > c, a.s., it holds a.s. that Xt > c for each t G Vt- The right-continuity of the process X then 

implies that except on a null set N, Xt > c for any t G [0, T]. Thus we see from (A4) that X'^ = {Xt — c}t(z[Q T] is 
a non- negative 5-supermartingale. For any n G N and A G -Ft C J^,y\/t, (A2), (A3) and Proposition 12.31 implv that 

£[1aX^^,J = £[£[lAX-^,jTt]] ^ £[lA£[X^,.yt]] < £[1aX^]. (8.17) 

We also have that .^^[l^X^wJ — hm <f [l^X^t]. The proof is similar to that of (|8.14p . (We only need to replace 
X+ by X^vt and A:^+(t) by X^t in the proof of ((5111) ). As n ^ oo in (jSTTl) . (A2) and (A3) imply that 

£[lAXn > lim £[1aX^,.] = £[lAX^.^t] ^£[£[lAX^.^t\^t]] =£[lA£[X'.^t\^t]]. 

Applying Proposition O (3), we obtain that £[A:^vtl-^t] < ^ti a.s. Then (A4) and imply that 

£[X,vt\Tt] = £[X,vt\J't] = £[X^vt + c\Tt] = ^Kvtl-^t] +c<X^ + c = Xt, a.s. 

Since {z^ < i} G J^t, we can deduce from (A3) and (A4) that 

£[X,\J^t] = ^[1 {u>t}X^s/t + l{u<t}X^M\j^t] — l{iy>t}'S^[Ar^Vt 
^ '^{iy>t}Xt + l{iy<t} A",yAt = X,^;^t 0,.S. 

Hence, we can find a null set N such that except on N'^ 

£[Xi^\J^t] < AT^Atj for any t G and the paths of £[Ary|J^.] and A"^a- are all RCLL. 
As a result, on TV^ 

£[X,\J^t] < X,M, yte[0,T], thus ^[X.IJ-,] < V(7G5o,t. □ 
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Proof of Proposition [2771 1) If < 77, a.s., by (Al), it holds except on a null set N that 

^["^l-^t] < ^[77!-^*], for any t E Vt and that the paths of and £[77|7^.] are all RCLL, 

which implies that on N'^ 

mJ't]<£[ri\J't], Vte[0,r], thus mT,]<8UF,]. 

Moreover, if f [^|Jv] = f [vyjJv], a.s. for some cr e Sq.t, we can apply (|2.8p and Corollary 12. 31 to get 

f K] = m = S[m:F.]] = E[8[r,\F.]] = £[77] = £[77]. 

Then (A4) implies that E[S, ~ c(0] = ^^K] - c(0 '^W - c(0 = ^b? - c(C)]. Clearly, < ^ - c{S) < t] - c(0, a.s. 
The second part of (Al) then implies that ^ — c(^) ^ rj ~ c(^), a.s., i.e. £, = rj, a.s., proving (1). 

2) For any yl G and 77 G Domf {£), we let {fn},igN be a decreasing sequence in S/^rp such that lim 4,f„ = i^, 
a.s. For any n £N, since A e and 77 e Domf^{£), Proposition (2) and (3) imply that 

£[1a^\T.J = lAmJ^.J, and + 7j\J^,J ^ mJ^uJ + V, a.s. (8.18) 

Then we can find a null set N' such that except on N' 

(IS3H1) holds for any 7^ e N and the paths of f [l^CI^.], £[^\J'-] and £[^ + r]\T.] are aU RCLL. 

As 71 -> 00, it holds on {N'Y that 

£[1a^\T,] = lim £[1a^\T,J = lim Ia^^KI-^.J = UmJ".], 

n— >-oo 71— j-oo 

and that £[^ + 77] J"^] = Hm £[C + 77] J^^J Hm £[^\T^J + 77 = £[^\T^] + 77, 

proving (2) and (3). Proofs of (4) and (5) are similar to those of Proposition 12.21 (1) and (2). The proofs can be 
carried out by applying the just obtained "Zero-one Law" and "Translation Invariance" . □ 

8.2 Proofs of Section |3] 

Proof of Lemma 13. It (1) Let £ be a positively-convex F-expectation. For any A e J^t and 7i G N, (Dl) and 
(D2) imply that IajTlIa G Dom{£). Then the positive-convexity of £ and Proposition 12.21 (2) show that 



1 



n 



1 , Ix..,, 1 , . 1. .. 1 



£[1a] = £ -(nlA) < -£[nlA] + (l - -)£[0] = -£[nlA] + (l - -) ■ = -£[nlA]- (8.19) 



71 n n n n 



Since P{A) > 0, one can deduce from the second part of (Al) that > 0. Letting n ^ 00 m (|8.19p yields that 

lim i5[7i1a] > lim 7i£[1a] — 00, 

thus £ satisfies (HO). Moreover, for any ^,77 G Dom*{£), A G (0, 1) and t G [0,r], we can deduce from (|2^ . (A4) 
and the positive-convexity of £ that 

£[Xi + \)rj\^t] = £[\^ + (1 - A)77| J-,] = £[\{C - c(0) + (1 - A) (77 - 0(77)) | J",] + Ac(0 + (1 - A)c(77) 
< A£K - cm^t] + Ac(0 + (1 -X)£[ri - c{7^)\Tt] + (1 - A)c(77) 
= X£[^\Tt] + il-X)£[v\:Ft]^XmTt] + il-X)£[v\Tt], a.s., 

which shows that £ is convex in the sense of (|3.ip . On the other hand, if £ satisfies (|3.ip . since Dom'^{£) C 
Dom^{£), one can easily deduce from (|2.8p that £ is positively-convex. □ 

Proof of Proposition 13. ll We first check that £!j^j satisfies (A1)-(A4). For this purpose, let £,,rj E A# and 
te[Q,T]. 
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1) If C < ^-S-, applying Proposition 12.71 fl) to £j yields that £j[^\Ti,yt] < ^jbyl-^fvt], a.s. Then (Al) of £i and 
p.3p imply that 

Moreover, if < f < 77 a.s. and £l^[£_] = £lj['n] (i.e. J"^]] = £, [£j[r]\J^^]] by dSJ])), the second part of (Al) 

implies that fj[^|Jv] — £j[ri\J^^], a.s. Further applying the second part of Proposition 12.71 (1). we obtain £, — rj, 
a.s., proving (Al) for £^.j. 

2) Next, we let < s < t < T and set St = £1^ [^\j't] . Applying Proposition O (2) to and £j, we obtain 

^hj =l{i'<s}^J + '^{iy>s}£i [£j ["* l-^i^] \^s] = £j [l{i^<s}2t I J^i] +£i[£j [l{y>s}Sf I J'ly] I J's] , a.s., 



where we used the fact that {i^ > s} G J-iyA.s thanks to lKaratzas and Shrevd 199ll Lemma 1.2.16]. Then (A3) and 
(A2) imply that 

^i[l{i/<s}2f|j"s] = £j[l{j,<s}fj[^|j'j] I J-^] = l^^^^y£j[£j[^\Tt]\J^s] = l{,y<s}fj[^| -Fs], a.s. (8.20) 
On the other hand, we can deduce from p.2p that 

Since both {s < ly < t} — {i' > s} D {v > and {ly > t} belong to J^jyAt, Proposition 12.71 (3) and (2) as well as 
CoroUarv 12.31 implv that 

£] [l{iy>s}2t| £j [l{s<iy<t}£j[^\J^t]\j^^] + 'i-{iy>t}£i[£j[£,\J^iy]\j^u/\t] 

= '^{s<,^<t}£j[£j[i\J^t]\J^iy] + 'i-{u>t}£i[£j[£.\J^iy]\J^t] = 'i-{s<u<t}£j{^\J^i'At] + £i['i-{^>t}£j[^\J^i']\J^t] 
= £i[^{s<u<t}£j[^\J^u/\t] + 'i-{,^>t}£][£.\J^u]\J^t] ^ £i[i-{s<iy}£j[^\^v]\J^t], a.s. 

Taking £i [ • | J^;] of both sides as well as using (A2) and (A3) of £i, we obtain 

£i[£j[il^^s]Et\!Fu]\J^s] ~£i £i['i-{s<u}£j[^\^iy]\^t] J^s —£i['i-{s<u}£j[^\J^i^]\J^s]='i-{u>s}£i[£j[^\^i^]\^s], a.s., 

which together with (|8.20p yields that 

^l, [^Ij [^\^t]\^s] = l{.<s}£i [^\^s] + l{,>s}£. [£j [^\^.]\^s] = £Ij [e| J".] , a.s., proving (A2) for £1^. 

3) For any A ^ Ft, using p.3p . (A3) of £i as well as applying Proposition 12.71 (2) to £j, we obtain 
£l^[lA£.\Ft] ^£,[lA£M^.^t]\:Ft] - lA£^[£M\:F,yt]\J't] = a.s., proving (A3) for £1^. 

Similarly, we can show that (A4) holds for £^ ^ as well. Therefore, £^ ^ is an F-expectation with domain A'^. Since 
A G ^T, i-e. M C A, it follows easily that M C A#, which shows that A# e ^t- 

4) Now we show that satisfies (HI) and (H2): For any ^ £ A+ and any {A„}„gN C J-t with lim tlA„ = 
1, a.s., the Dominated Convergence Theorem (Proposition 12. 9p implies that limt^i [lyi„CI-Fi^] = £iW\^A^ a.s. 
Furthermore, using (13. 3p and applying the Dominated Convergence Theorem to £i yield that 

YYmJ£l^[\A^(\ = YmiJ£,[£,[lA^£.\T,]] = £^[£M\^A] - £l,[(\, proving (HI) for £1^. 
With a similar argument, we can show that £^ ,j also satisfies (H2). 

5) If both £i and £j are positively-convex, so are £i and £j thanks to (|2.8p . To see that £^ ^ is convex in the sense 
of (EH, we fix 7] G A#, A G (0, 1) and t e [0, T]. For any s e [0, T], we have 

£j[Xi + (1 - X)v\Ts] < \£A^\J's] + (1 - mivlJ's], a.s. 
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Since £j[\S, + (1 — \)ri\J'.], £j[£^\T.] and £j[77|7^.] are all RCLL processes, it holds except on a null set N that 

J,[X^ + {1 - X)v\Ts] < \£j[^\Ts] + {l-X)£MJ'sl Vse[0,T], 
thus £,[Ae + (l-A)7y|J-,vt] < X£j[^\T,yt] + {I - X)£j[Tj\T,yt]- 

Then p. 31) implies that 

^mIAC + (1 - m^t] = £^[£M + (1 - ^)v\J'.vt]\Tt] < £^[X£J[C\J'.vt] + (1 - X)£M^^^t]\J't], 

< X£,[£j[^\T,^t]\Tt] + (1 - X)£,[£,[7^\J^,vt]\J^t] = X£i:^^[^\J^t] + (1 - A)f,';^-[77| J"*], a.s. □ 

8.3 Proofs of Section H 

Proof of Lemma 14. It For any i G I, it is clear that Hq = and that (|4.2I) directly follows from (hi). For any 
s, i G T>T with s < t, we can deduce from (h2) that 

Hi^^J^hi.dr>cJ^ds>cT, a.s., (8.21) 

which implies that essinf HI f > cT, a.s. Thus (S2) holds with Ch = cT. 

s,teVT-;S<t ' 

If no member of satisfies (|2.5I) . then \h{ \ dt G Dom{S') for some j G X is assumed. For any G Vt with 
s < t, we can deduce from (|8.2ip and (h2) that 

CH<Hit< f \hl\dr< f \hi\dr, a.s., 

Js Jo 

which implies that Ch < esssup ^ < \hl\dr a.s. Then Lemma [3.21 shows that esssup f G Domes'), 

s,teT>T;s<t ' s.teV-r-.sKt 

i.e. (|4.3p . Moreover, we can derive (S3) directly from (h3). □ 
Proof of Lemma 14. 2t For any i, j G X' and pi,p2 G U, we consider the event 

A = [£, [X{p,) + Hlp,\T,] < £, [X{p2) + Hl^p^ I J-,] } G J-., 

and define stopping times p = /O2IA + Pi^A" & ^ and viA) = vIa + TIa" G Sv,t- Since ^' = {fijjgj/ is a 
stable subclass of <o, Definition 13.21 assures the existence of fc = k(i, j,v{A)) G I' such that £k = £if^- Applying 
Proposition 12. 71 (5) to £j and Proposition [5?7] (3) & (2) to £i, we can deduce from p.3p that for any ^ G Dom{S') 

£k[i\TA = £':f\s.\TA = £^[£A^\Tu^A)v^\^u\ = £,{iAm\:F,] + 1a^£,[£.\Tt]\t,] 

= £^[iA£M^A + '^A^£.\:F,]^iA£j[e.\Tu] + '^A^U^\J'A. a.s. (8.22) 

Moreover, (|4.5p implies that 

Then applying Proposition 12. 71 (2) to £i and £j, we see from (|8.22p that 

£k [X {p) + Ht^p I J-,] = 1^£;- [X {p) + Ht^p I J-,] + 1^.= [X ip) + H^^p I J-,] 

= [1a^(P2) + lA-ffi5,p, 1^,.] + £^ [lA^X{pi) + Ia^K^p^ I J-,] 

= 1^£;- [X(p2) + i?^,pj-^.] + [^(pi) + K.p.lJ'^] 
= £, [X(p^) + Hl^p^ I J-,] V £j [X{p2) + Hi^p,\T,] , a.s. 

Similarly, taking p' = piIa + P2^A'' and k' — k(i,j, z^(A'^)), we obtain 

£k' [Xip') + Ht[p,\F,] - £, [X{pi) + Hl^p\F,] A £, [X{p2) + H^Jj^,] , a.s. 
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Hence, the family \ £i \X(p)+Hl, „| Jv] \ is closed under pairwise maximization and pairwise minimization. 

I ill J(i,p)6l'xl/ 

Thanks to iNeveul |1975i Proposition VI-1-1], we can find two sequences {(in,Pn)}„gN ^"^^ {i^'n^ P'n)} nen val' y.U 
such that glD and hold. □ 

Proof of Lemma mH We fix e 5o,t- For any {i,p) e I x 5^,t, (|4J1) . and Proposition O (5) show that 
£i\Yp + Hlp\Ti,'\ > = C* , a.s. Taking the essential supremum over {i,p) G X x Si^^t gives 

= esssup £i[Yp + Hlp\j'^]>C'^, a.s. 

Then for any i £ I, g^]) implies that Z'(t^) = + HI > + Ch ^ Cy + ^Ch, a.s. 

If no member of (a satisfies (|2.5p (thus ()4.6p is assumed), then for any {i,p) G I x iSi/_t, it holds a.s. that 

S^[Y;\Tt]<CY, ytevr. 

Since Si [Yp\j-.] is an RCLL process, it holds except on a null set N — N{i, p) that 

£^[Y;\Tt]<QY, Vie[0,T], thus S^[y;\F,]<Qy- 
Moreover, Proposition 12. 71 (3) and (|4.4p imply that 

Cy > £^ [y;\J^,] = [Yp + KjTu] +Hl>£, [Yp + Kjj^,] + Ch, a.s. 
Taking essential supremum over {i,p) G I x iSj/^t yields that 

Z{iy) = esssup £i[Yp + Hl^p\T„] < (y - Ch, a.s. 

where Cy - Ch 6 Dom{<g) thanks to (HH) and (D2). Hence, for any z G X, we have Z\v) = Z{v) + Hi < 
Cy - Ch + Hi, a.s. And (gj]) together with (D2) imply that Cy - Ch + HI e Dom{S). □ 

Proof of Lemma 14. 4t If no member of S satisfies (|2.5p . then we see from Lemma [4.31 that 

C.<Z{v)<Cy-Ch, a.s., 

and that (y ~ Ch G Dom{<S). Hence Z{v) G Dom{<S) thanks to Lemma [221 

On the other hand, if £j satisfies (|2.5p for some j G I, letting {X,X' ,U) = {Y,X,S^^t) in Lemma [4.21 we can 
find a sequence {(in,Pn)}„gN in X x S^^t such that 

Z{v)= esssup £^[Yp + HI \T^]= \\-m^£,^^\Yp^+ Wj- a.s. 



For any n G N, it follows from Definition 13.21 that there exists fc„ = k{i,in,v) G X such that £k„ — Applying 
Proposition 12. 71 (3) to £k^, we can deduce from (14. 4p . p.3p and (|4.5p that 



^fc. [^pI"] - = [^'p^ + H'p: - Ch] = £k„ [Yp„ + + - ^ [^p. 



H, 



v,Pn 



which together with (Y2) shows that 



lim £j [Yp^ + K^pjT,] < sup £, [r;] ^Ch<oo. 

n-ioo L ' -I (i,p)eIx5n,T 

For any n G N, (|IT7)) . and Proposition [HT] (5) imply that 
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Therefore, we can deduce from Remark 14.21 (1) that 

For any i G I, (g^l) and (D2) imply that Z'{i^) = Z{v) + HI e Dom{S). □ 



A 



Proof of Proposition [47ll To see (|4.14p . we first note that the event A — {v ~ a} belong to Jva<t thanks to 



Karatzas and Shreve 



1991 . Lemma 1.2.16]. For any i e I and p £ S^^t, we define p{A) = plA + TIa", which 



clearly belongs to Sa,T- Proposition 12. 71 (2) and (3) then imply that 

Uir [Yp + Kjj^,] = 1a il, [Yp + Hl\F,]-H^) =1a (£^ [Yp + Wp\j^,] - ^ ul, [Yp + Hip \ J",] 



= £^ [1a{Yp(A) + Hlp(^A))\^'y\ = '^A^i \yp{A) + Hl^p(A) 

< 1a esssup £i\Y^ + Hl_^\Ta\ =1aZ{(7), a.s. 

(i,7)elx5„,r 

Taking the essential supremum of the left-hand-side over (i, p) E I x S^^t and applying Lemma 13.31 (2), we obtain 
1aZ{v)^1a esssup £i\Yp + HI p\Ty\ ^ esssup [lA£t\Yp + HI p\Tu\\ <lAZ{a), a.s. 

Reversing the roles of v and cr, we obtain (|4.14l) . 
As to (|4.15l) . since S^^t C iS,/,t, it is clear that 

esssup [Fp + iJ* p I < esssup £i\^p + H'\^J\T^= Ziv), a.s. 

(i,p)GlxS.y,r ' (i,p)Glx5„,r 

Letting {X, v,!' ,U) — (Y, 7,1, 5^^^) in Lemma 14.21 we can find a sequence {{hu Pn)} ^^^j^ in I x 5^,t such that 
Z(7) esssup £i[Yp + H' AT-y] ^ lim t f i„ [yp„ + ffi" [^7], a.s. 

Now fix j G I. For any n G N, it follows from Definition 13.21 that there exists a fc„ = k{j,in,^) G X such that 
£k„ = Applying Proposition 12.71 (3) to £i^, we can deduce from p.3p . (|4.5p that 

esssup f , [Yp + Hlp\T,]> f fc„ [Yp^ + Hf/^p^ | J",] - f 7,.^ [Yp^ + H^^-p^ | J",] = £, [Yp^ + iJ^;^^ 

= £j [yp„ + h!;^p^ + n^r^lT,] = £, [4 [Yp^ + Hl;^p^ + Hi^^\F,] , a.s. (8.23) 
For any n G N, Proposition [1?71 (5), and show that 

Cy + 2Ch = K {C*\T^\ +Ch< K ^p^ + ■ff;?p„ 1-^7] + ilia ^ ^(^) + ^^,7' 

where .^(7) 4- ^^^^ G DomiS) thanks to Lemma [4.41 (|4.2p and (D2). Then the Dominated Convergence Theorem 
(Proposition imi) and (|8.23p imply that 

£,{Z{-i) + Hl \T,\^XYXii£,\£,,}^p,^+Hl:^ \T^\^Hi \T^< esssup £^^p+Hl \T,\, a.s. 

Taking the essential supremum of the left-hand-side over j G X, we obtain 

esssupf,- [^(7) -fiJ^..^! J^i.] < esssup [Yp -f i?^ J",,] , a.s. (8.24) 

jei ' (i,p)eix5^,T 

On the other hand, for any i G X and p G iS^,t, applying CoroUarv 12.31 and Proposition 12.71 (3). we obtain 

£,^p + Hl^p\T,\ = £,[£,[Yp + HljT^]\j^,] ^ £,[£,[Yp + h;JJ^^] + Hl^^\T,] 
< f,;[Z(7) + i/^_^|j-,] <esssupf,[Z(7)+i7:.^|j-,], a.s. 
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Taking the essential supremum of the left-hand-side over (i, p) G I x S-y,T yields that 
esssup £i [Yp + Hl J\Fv\ < esssupfi [Z{l) J>] , a.s., 

which together with proves (|i?T5|) . □ 

Proof of Proposition [4721 For any i G X and i^, 7 G iSq.t with ly <j, a.s., Proposition 12.71 (3). ()4.15p imply that 
£,[Z\p)\T,] = £,[Z{p) +HljT,] +HI < esssup£,[Z(p) +HIJT,] +HI < Z(y) +HI = Z\v), a.s., 

which implies that {^*(^)}(gjQ is an fi-supermartingale. Proposition l2.6[ Theorem l2.3l and (|4.12[) then show that 
\ZI'^= ]mZ'{q+{t))\ defines an RCLL process. Moreover, (|4.12p implies that 

n^oo tG[0,T] 

essinf Z\t) > Cy + 2Ch, a.s. (8.25) 
te[o,T] 

If £j satisfies (|2.5p for some j G I, CoroUarv 12.21 and (|8.25p imply that 

Zl'+ e Dom*{£j) = Dom{,ff), Vi^g5o,t, (8.26) 
and that Z^^'^ is an RCLL fj-supermartingale such that for any t G [0,T], Z^'^ < Z^{t), a.s. (8.27) 



Otherwise, if no member of £ satisfies p.Sp , we suppose that ()4.3p holds for some j G I. Then Lemma 14.31 and 
(|4.3p imply that for any t G Vt, 

Cy + 2Ch < Z^ (t) = Z{t)+ Hi <Cy-Ch+ C , a.s. 

Taking essential supremum of Z^ (t) over t G T>t yields that 

Cy + 2Ch < esssup Z^ (t) < Cy - Ch + C , a.s., 

where C.y - Cr + G Dom{S) thanks to (jM]), (|43l) and (D2). Hence Lemma l372l implies that esssup Z^'(t) G 

Dom{S) = Dom*{£j). Applying Corollary and (|8:25)) again yields (|8:26)) and ([OT)) . 

To see that is a modification of {■^■'(Oj^gjo t]' suffices to show that for any t G [0,r], Zl'~^ > Z\t), 
a.s. Fix t G [0,T]. For any {i,v) G I x 5t^T, Definition 13.21 assures that there exists a. k — k{j,i,t) G I such that 
£k = £l,. (SI) and gH) imply that 

^Hl^ = Hl,=Hl and H^, = HI,, a.s. (8.28) 

For any n G N, wc set t„ = (7,^(i) and define z/„ = (i^ 4- 2^") A T G 5t,T- Let m > n, it is clear that tm < tn < Vn, 
a.s. Then Proposition 12.71 (3) implies that 

K \J^tJ = ^fc [r,„ + H^^^,^ \TtJ + Hl^ < Z{tm) + i^t = Z^ (tm) + i^L - , a.s. 

As m 00, ()8.28p as well as the right-continuity of the processes £k \Xu„ j-T-".] , H^ and H^ imply that 

£k [Y^ I = lim £k [Yl \TtJ < lim Z\tm) + - H{ = lim Z^ (tm) = Zl+ , a.s. 

Since limj,z/^ = a.s., the right continuity of the process imphes that Yj^ converges a.s. to Yj^, which belongs 
to Dom{(o) due to assumption (Yl) and (|4.2D . Then (14. 8p and Fatou's Lemma (Theorem 12. Ip imply that 



£k[Y!:\Tt] < ijm £k[Yl\^t] <zl 



a.s. 
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Applying Proposition 12. 71 f5) and (3) to £j and £i respectively, we can deduce from (13. 3p and (|8.28p that 

Zi'+ >£k[Y^^\Tt] ^ £l,[Y^^\j^t] =£j[£^[Y^\Tt]\J't] =^Y^^\Tt] = £,[Y, + Hl,\j^t] + a.s. (8.29) 

Letting (i, v) run throughout I x St.r yields that 

Zi+ > esssup [Y^ + HI,, | + i?/ = + iJ^*' = Z^t), a.s., 

{i,w)£lxSt,T 



which implies that Z^-^ is an RCLL modification of {^■'(t)}^^^^ ^j. Correspondingly, Z'^ = {z{'^ — ij/j^^jp is an 
RCLL modification of Moreover, for any i e I, Z*'" = {Z° + _ffj j^^j^ defines an RCLL modification 

of {^*(i)}(g[o T]' ^^^^ fi-supermartingale. □ 

Proof of Proposition l4T3l For any t G [0,r], we know from (|ilT]) and Proposition H^] that Yt < Z{t) = Z^", a.s. 
Since the processes Y and Z° are both right continuous, it follows from Remark 14.31 (2) that dominates Y. 

If £ S^rp takes values in a finite set {ti < ■ ■ ■ < for any a £ {1 • • • n}, we can deduce from (|4.14p that 
l{i,^t^}Z{v) = l{^^t^}Z{ta) = l{y^t^}Zt^ = l{^^t^}Z°, a.s. 
Summing the above expression over a, we obtain 

= Z(i^), a.s. (8.30) 

For general stopping time v G Sq^t-, we let {i^n}n£N ^ decreasing sequence in Sqj, such that lim 4,zy„ = J^, a.s. 
Thus for any z e I, the right-continuity of the process Z*'" shows that 

Z'f = lim Z^'*', a.s. (8.31) 
For any n S N, (|O0)) and (|4?T2t imply that 

Z^f = Z^t^n) > Cy + 2Ch, a.s. (8.32) 
If satisfies (|2.5p for some j G I, we can deduce from (|4.16p and (Y2) that 

£, [Zif] = £, [Z^ (;.„)] < Z^ (0) - Z(0) - sup £, [Yp + H;] < oo, 

(i,p)eix5o.T 

thus lim £j[Zl-^] < oo. Then Remark|42] (1) implies that Z^'O e Dom{S). 

71— J-OO 

On the other hand, if no member of S satisfies (12. 5p . we suppose that (|4.3p holds for some j G T. In light of 
Proposition 14.21 and Lemma [4.31 it holds a.s. that 

Cy + 2Ch < Zi° = Z° + Hi = Z{t) + Hi <Cy-Ch + V< G Vt, 

where C,y — Ch + C"* G Dom{S) thanks to ()4.6p . (|4.3p and (D2). Since Z^'° is an RCLL process, it holds except on 
a null set N that 

Cy + 2Ch < Zi'"^ <Cy-Ch + Q', V i g [0, T] , thus Cy + 2Ch < < Cf - + . (8.33) 

Lemma [321 then implies that Z^'° G Dom{S'). We have seen in both cases that Zl''-* G Dom{S) for some j G I. 

Since Z-'-'^ is an RCLL i?j-supermartingale by Proposition 14.21 (|8.32p and the Optional Sampling Theorem 
(Theorem El) imply that f,- [ZJ;0| J^^^^J < Z'l^^^^, a.s. for any n G N. Applying Corollary [23] and Theorem [23| 
once again, we obtain 

£, [Z^;° l-F.] = £, [£, [^^;° J < £, [Zi'^^^ < Z^-o, a.s., (8.34) 
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which implies that lim "[Ej \Zi'^\j^„] < Zi'^, a.s. On the other hand, using (|8.31l) and (|8.32l) . we can deduce from 
Proposition 12. 71 (5) and Fatou's Lemma (Theorem 12. ip that 

Zi'" = £j [Zl'° I J-,] < lim t [Z^^\^,] < Z^°, a.s. 
Then ((OOl) and (|4T6)) imply that 

Zi-° = limits, \Zi-^\T J = limits j\Z^{vn)\J'A < Z^i^)^ a.s., thus Z° < Z(j/) a.s. (8.35) 

On the other hand, for any (i, p) E I x S^^t and n G N, we define p\l Vn G Proposition 12.71 (3) 

implies that 

Taking [ ■ | Jv] on both sides, we see from Corollary 12.31 that 

It is easy to see that limj,p„ = p, a.s. Using the right continuity of processes Y and iJ*, we can deduce from (|4.8p . 
Fatou's Lemma (Proposition I2.8P and (|8.35l) that 

< lim^^KJ-F.] < Xml^£^{Z\v,,)\T,\ = Z]f , a.s. 

n — ^oo n— ^oo 

Then Proposition 12.71 (3) again implies that 

[Yp + KjT,] = £, J-,] - HI < Z'f -Hl = Zl, a.s. 

Taking the essential supremum over (i,/?) G I x S^.t yields that Z{y) < a.s., which in conjunction with (j8.35p 
shows that = Z(y), a.s., thus Z° G Dora(S) by Lemma WM Moreover, for any i G I, we have 

Z'f = Zl + lil = Z{v) + Hl^Z\v), a.s., 

thus Z*'" G Dom{S') thanks to Lemma l4^ once again. (|4.17p is proved. 

Now let X be another ROLL F-adapted process dominating Y such that X"^ = jX^ + iJ^ j^^j^ is an £i- 
supermartingale for any i G X. We fix i G [0,r]. For any i G I and ly G St^T, we let {t'nlneN be a decreasing 
sequence in Sfrp such that lim li^n ^ i^, a.s. For any n G N, since X* dominates y, Remark 14.31 (1) shows that 
X*^^ > Y^^, a.s. Then (A4), Proposition l2.6l and the Optional Sampling Theorem (Theorem 12. 4p imply that 

£, [Y,^ + Hl,^ I J-t] = £, \y:^ \j^t] ~ HI < £, [Xl^ \j^t] ~ HI < XI ~ HI = X^ a.s. 

The right-continuity of the processes Y and shows that — hm (Yj^^^ ~^^t u ) ^ ^^^^ fohows from 

(|i?7|) . ((i^ and Fatou's Lemma (Proposition [Ml) that 

[Y, + l-^t] < lim + Hl^^ \Tt] < Xt, a.s. 

n— >oo 

Taking the essential supremum of the left-hand-side over (z, z/) G X x St^T, we can deduce from Proposition l4.2l that 

Z° = Z{t) = esssup £i [1^ + Hl „\Tt] < Xt, a.s. 

Since both Z'^ and X are RCLL processes. Remark 14.31 (2) once again shows that X dominates □ 
Proof of Lemma 14. 5t For any i El, (I4.18p . (|4.4p as well as Proposition 12. 71 (5) imply that 

+ I J-,] > £, [a + Ch| -F.] = + 2Ch, a.s. 
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Taking the essential supremum of the left-hand-side over z £ I, we can deduce from (|4.19p that 

Cy+2Ch < esssupf,[zO^(,) = Jsiv) < Z{v), a.s. (8.36) 

Then Lemma [3.21 imply that Js{v) G Dom{S'). Let a be another stopping time in 5o,t- In light of (|4.17p and 
(|4.14p . we see that 

i{Ts{u)=Ts{<T)}Z°^{„) = ^{Ts{u)=Ts(a)}Z{Ts{iy)) = 1 { (^) (^) } Z (t^ ((t) ) = 1 {r^ {u)=Ts {<t)} (a) ^ (8-37) 

It is clear that — a} d {ts{i^) — Ts{a)}. Thus multiplying l^i^^cr] to both sides of (|8.37p gives that 

l{i/=a}^r,(i.) = ^{u=a}Z°^(^„y U.S. 

For any j G X, applying Proposition 12.71 (2) and recalling how ^-^d defined in (|2.6I) . we obtain 



where we use the fact that {u = a} G J-vao- thanks to iKaratzas and Shrevd 199ll Lemma 1.2.16]. Taking the 
essential supremum of both sides over i £l, Lemma 13.31 (2) implies that 



l{„=a}JsM = eSSSUpl{^=<,}£,[^r,M + ^^,r, hI ■^''] = SSSSUp [^r,(<T) + -^^,t, (a)| -^^l =l{^=a}^<sM, O.S., 

which proves the lemma. □ 
Proof of Proposition l474l 

Proof of 1. We fix i G X and v^p & So,t with v < p, a.s. Taking {v,I' ,U) = and X(t5(p)) = Z'^^f^^-^ 

in Lemma [4.21 we can find a sequence {jn}^i in X such that 

J,(p) = esssupf,[ZO^(^) = Jimt4[Z0^(^) a.a. 

For any n G N, it follows from Definition 13.21 that there exists a fc„ = j„, p) G I such that Zk^ — ^ . Applying 
Proposition 12. 71 (3) to we can deduce from p.3p and (|4.5p that 

■^fc" [^". (p) + ^l^r, (p) I -^^] = '^0. [^r, (p) + ^l:r, (p) I -^''] = [^0^ [^r, (p) + ^^'."r, (p) | -^^p] | 

= ^44K(p)+^f^:.,(p)l-^p]+^:.p|-^.], (8-38) 

Since v < p, a.s., we see that ts{v) < Ts{p), a.s. Due to (|4.17p and (|4.15p . we have that 

[Zrs(p) + ^r;(.),r.(p) l^rsi.)] < eSSSUp f , [Z{rs{p)) + | < Z{ts{v)) = a.s. 

Then using Corollarv l2.3l and applying Proposition 12.71 f3) to £k,^, we obtain 

^fc" [^rs(p) + ^^,r,(p) l-^!^] = [£k„ [Zr,{p) + H^"rs{p)\^rsii^)] 

= ^fc„ [^^fc„ [Zr,(p) + -^r,V),r,(p) |-^r,(,.)] + 

< <esssupf,[Z°^(,)+i/,^.^ |J-,] = J,M, a.s., 

which together with (|8.38p shows that 

^»[4K(p) + ^^;;,(p)l-^p] +ff;p|-^.] < M'^), a.s. 

For any n G N, we see from (|4.18p . (|4.4p and Proposition UTT] (5) that 

4 [<(p) + ^^^:.,(p) \^p] + K,p > [Cy + 2Ch\Tp] +Ch = Cy + 3Ch, a.s. 
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Then Fatou's Lemma (Proposition 12.81) implies that 

[Js{p) + i?:,p|^.] < Vm^jl [4 [Zo^(p) + I J-p] + KjF,] < .h{v), a.s. 

For any a £ 5o,t, Lemma 1431 (|4.2p and (D2) show that J^(cr) = ^^(cr) + -ff^ ^ Dom{S'). A simple application of 
Proposition 12. 71 (3) yields that 

£,[Jl{p)\T,] = £,[Js{p) + KjT,] +Hl< Js{v) +Hl^ Jl{v), a.s. (8.39) 

In particular, when < s < i < T, we have [ J|(t) < Jgis), a.s., which show that {Jsit)} t^[Q is an 
fi-superniartingale. 

Proof of 2. For any i e I and i' £ 5o.t, (|8.36p and (|4.4p imply that 

JK^^) = J5(i^) +HI>Cy+ iCH, a.s. (8.40) 
In particular, Ji(r) > Cy-|-3C//, a.s. Proposition l2. Gl and Theorem l2.3l then show that w/'*'^ = lim Jl('Z,t(i))| 

I- n^oo J ie[0,T] 

defines an RCLL process. Then (|8.40p implies that 

essinf Jl(t) > Cy + SCh, a.s. (8.41) 

*6[0,T] 

If £j satisfies ()2.5|) for some G I, Corollary 12.21 and ()8.4ip imply that 

4'^'+ e Dom*{£j) = Dom{S'), Vi^eSo.T, (8.42) 
and that J^'^'^ is an RCLL £j-supermartingale such that for any t G [0,T], jf''''^ < Jgit), a.s. (8.43) 

Otherwise, if no member of (§ satisfies p.Sp . we suppose that (|4.3p holds for some j £ I. Then (|8.40p . (|4.19p and 
imply that for any teVr, 

Cy + iCn < Jl (t) = Js (t) + Hi <Z{t) + Hi < (y - Ch + C , a.s. 

Taking essential supremum of Jg (t) over t e Vt yields that 

Cy + 3Ch < esssup (t) < Cy - Ch + , a.s., 

teVr 

where (y — Ch + C"* £ Dom{S) thanks to (|4.6p . ()4.3p and (D2). Hence Lemma [3.21 implies that esssup J^(i) £ 

teVT 

Dom{S) = Dom*{£j). Applying Corollary and ^^A\\ again yields (15:42)) and dUS]). 

To see that J^'^'^ is a modification of {•^KOltg^o t]' suffices to show that for any t £ [0,T], Jp'''^ > Jj(i), 

a.s. Fix t £ [0, T]. For any i £ I, Definition 13.21 assures that there exists a fc = k{j,i,t) £ I such that ffc = fjj. 
Moreover, (SI) and (|4.5p imply that 

H^^Hl,^Hl,^Hl and H^^^^^,^ ^ Hl^^^,^, a.s. (8.44) 

For any n £ N, we set t„ = 9n (0- Let m > n, it is clear that tm < in, a.s. Then ()4.17p . Corollary 12.31 Proposition 
[2Jl (3) as well as (|4T5l) imply that 

£k[z'^-ljTtJ = ffc[z''^(T5(i„))|j-t„] ^ £k[£k[z\Ts{tn))\J'rs{t^)]\J'tJ 

= £fc fc [Z(t5 (t„ ) ) + ( ) ( ) I J"^, ) ] + ^Ts{t^)\^t„,] + -fftt. 

< gfc[esssupfi[Z(r,(t„)) +i/t,(t„),.,(t„)|-^r.(t„)] + Ht,,s(tJ^t,„] + 

lex \ ' 

< £k [Z{Ts{tr,.)) + Hl^^^^.jTtJ + Ht < ess|upf, [Z%^,^^~^ + i?L,r.(t„) 1-^*™] + 

= Js (trn) + = Js (trn) + ^ ' 
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As m oo, (|8.44p as well as the right-continuity of the processes £k [^rf(t ) |-^ ] ' ^^^^ ™ply that 
MZrlJJ^t] = lim £k[z';f,^jTtJ < lim J'g{tm) + - Hi = hm Jj(t™) - a.s. 

Since limJ^r^fi^J = T(5(t) a.s., the right-continuity of the process Z^'^ imphes that Z^'? ^ converges a.s. to 
which belongs to Dom{S') thanks to Proposition I4.3[ Then (|4.18p and Fatou's Lemma (Theorem 12. ip imply that 

4 [Z';f^,^ 1^*] < lim I J-,] < J^'^'\ a.s. 

n— >oo 

Similar to ((H2H1), 

we can deduce from (I3.3P and (I8.44p that 



Letting i run throughout I yields that 



^■'+ > esssupf, [Z0^(,) + l-F,] + i?/ = Js{t) + Hi = Jl{t), a.s., 



which implies that J '^'^ is an RCLL modification of {Jl{t)}^^^^ ^j. Correspondingly, J"^^" = { - Hl}^^^^ 

is an RCLL modification of {Jsit)}^^^^ rpy Moreover, for any i e I, J^^^'^ = { + i?t j^^jp j,j defines an RCLL 
modification of {^K^)}tg[o t]' ^^'^^ fi-supermartingale. 

Proof of 3. Now let us show (3). Similar to (|8.30p . we can deduce from Lemma |4?5] that for any v e Sqj^ 

4'° = Jsiiy), a.s. (8.45) 

For a general stopping time v G 5o,t, we let {^'„}„pRi be a decreasing sequence in Sqj^ such that lim li/^ = i^, a-S. 
Thus for any i G X, the right-continuity of the process J"^'*'" shows that 

4''^° = lim 4''°, as- (8.46) 

In light of (|5:i5)) and (EMI), it holds a.s. that 

4'''° = Jlit) >Cy+ SCh, V< e Vt. 

Since J*'*'° is an RCLL process, it holds except on a null set N that 

> + 3Ch, Vt g [0,r], thus J^'*'" > Cy + 3Ch, Vct g 5o,t. (8.47) 

If £j satisfies (|2.5p for some j G I, we can deduce from (|8.39p . (|4.19l) and (Y2) that 

[J'f °] = £j [Jli^n)] < Ji(0) - Js{0) < Z(0) = sup [Yp + h;] < 00, 

('i,p)eix5o,T 

thus lim < oo. Then Remark^ (1) implies that 4^'" ^ Dom{S). 

On the other hand, if no member of S satisfies (|2.5p . we suppose that (14. 3p holds for some j G I. In light of 
dOSD, (|il^ and dUni), it holds a.s. that 

4'''° = = ^^(0 + < z{t) + i/,^' < - -I- vt G i^T, 

where - C'h + ^ Dom{<g) thanks to ((i?5)) . (|i31) and (D2). Since J''J''° is an RCLL process, it holds except 
on a null set N' that 

^■0 < Cy - + VtG[0,r], thus 4'''' <Cy -Ch + C,'. (8.48) 
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Then ([STf]) and Lemma [32] imply that J^'^-° G Do-mis'). We have seen in both cases that J^'^''~' G Dom[S) for 
some i G I. 

Similar to the arguments used in ([834]) through (|835l) (with (|8^ - (f8^ replacing (|830l) - (|R!32l) respectively, 
and with (|8.39|) replacing (|4.16p ) . we can deduce that 

Jf-^'^o^ limtfj[4:''"|j-.] - limt£,[JiK)|j-.^ thus J5'°<Ja-H, a.s. (8.49) 

The right-continuity of the process J'''°, (|8.45p and ()8.36|) show that 

lim = lim Js{vn) >Cy + 2Ch, a.s. 



n— >oo n— >oo 



Lemma B31 and Lemma O thus imply that J^^° G Dom{(S'). For any i G I, and (D2) show that J;^'''° = 

4'° + Hi G i:»om(^). 

On the other hand, for any z G X and n G N, it is clear that ly < i^n < ts{'^7i), a.s. Then Corollarv 12.31 (|8.49p 
and ([05)1 imply that 

It is easy to see that lim^T5(z/n) — ^s{j^), a.s. Using the right continuity of the process J*^'*'*^, we can deduce from 

n— >-oo 

([8^ . Fatou's Lemma (Proposition [M]) and (|8^ that 
Proposition 12. 71 (3) further implies that 



C r Ti5,0 , Tji I 77 1 _ P r T^-'^'^ I TT 1 Tji <r- J&-ifl Tji _ 7i5,0 



a.s. 



Taking the essential supremum over i G X gives 



J5(i/) = esssupf, ) + 1^,] < 4°, a.5., 

which together with (|8.49p shows that J^''^ — Js{i^), a.s. □ 

Proof of Theorem I4.lt We first show that for any S G (0, 1) and ly G 5o,t 

Jsiiy) = Zl = Z{v), a.s. (8.50) 

Fix i G I. Lemma [3.11 indicates that £i is a convex F-expectation on Dom{S'). Since Z'^'^ and J'^-'^o are both 
fj-supermartingales, we can deduce that for any < s < t < T, 

£, [<5Z0 + (1 - 5)jf " + H]\Ts] = [5Zf + (1 - 5)Jp'^^\Fs] < 58, J",] + (1 - 5)£, 
< <5Z:'0 + (l-<5)jf-^'0 = <5ZO + (l-5)jf'" + i/:, a.s., 

which shows that |(5Z° + (1 — 6)jf'^ + -ff^j is an ROLL £i-supermartingale. 

Now we fix i G [0,T] and define A = {T5(t) = i} G J-t. Using Proposition 14.41 (3), Lemma [3.31 (2) as well as 
applying Proposition 12.71 (2) and (5) to each £i, we obtain 

1aJP° = lAJsit) = lAesssupf, + I J-t] = esssupg; + 

= esssupfi [lA^t'l-Jt] = 1a^°, a.s. 

Then ([4T7)l and (|4?TT|) imply that 

lA(5ZO + (l-<5)jf°) = lA^O-lAZ(t)>lArt, a.s. (8.51) 
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Ys{oj) < SZ^ioj) + {1-S){Cy + 2Ch), Vs 6 [t,Ts{t){uj)) 
Since both Z'^ and Y are right-continuous processes, (|8.52l) and (|8.36p imply that 



(8.52) 



Yt < SZ? + (1 - S){Cy + 2Ch) < SZ^ + (1 - d)Jr a.s. on 

which in conjunction with (|8.5ip and Remark 14.31 (2) shows that the RCLL process SZ^ + (1 — S)J^'^ dominates 
Y, thus dominates Z*^ thanks to Proposition 14.31 It follows that J^'^ also dominates Z^. Then for any v G 5o,t, 
Proposition 113] (3), Remark 1131(1) and (|IT7| imply that Js{iy) = J^'° > Z^ = Z{iy), a.s., The reverse inequality 
comes from (|4.19p . This proves (I8.50p . 

Next, we fix 1/ e Sq.t and set (5" — n G N. It is clear that the sequence {"^(S" (^)}„gpj increasing a.s. to 

t(i/). Since the family of processes is "ff -uniformly- left-continuous" , we can find a subsequence {(5"*}fegN 

of {(5"}nGN such that 



lim esssup 



= 0, a.s. 



(8.53) 



For any i e X and fc e N, Remark HI] (1) implies that Y^^^^(^) > 5"^Z°^^^^^^^ + (l " S"^){Cy + 2Ch), a.s. Hence 
Proposition 12. 71 (3) shows that 

K^. M + Hl.r,., (.) (Cy + 2Ch) < (.) + H;^,, (.) \^.] K 



< esssup 

< esssup 



(8.54) 



^i[^yr,.,i^)+K.,i.A^A~^AYn'^)\^A +esssupf,[lV(.) 



Taking the esssup of the left-hand-side over I, we see from (|8.50p that 



esssup 



^^[;^^^r,„,(.) + +esssup£:.[y^(.) 

> J5-^{i^) + T^{CY + 2CH)^Zii^) + ^iCY+2CH), a.s., 
As fc ^ oo, and (HT5l) imply that 

Z(i/) < esssup^, + I J-,] < esssupf, [Z{t{i^)) + H^^^^^^ < Z{iy), a.s 



which shows that 



Z{iy) = esssup [y-(^) +Hly,^Aj^t,] = esssup fi[Z(T(i^)) + i/^^.^J J"^] , a.s. 

iei ' iex 

Now we fix p e . For any i £ I, Corollary 12.31 and (|4.16p show that 

£,[Z\T{,y))\T,] = £,[£,[Z\T{i,))\Tp] < S,[Z\p)\T,], a.s. 
Then Proposition 12.71 (3) implies that 

Si [Z{t{v)) + I J-,] = [ZXr(i^))l-^.] ~K<^^ {Z\P)\T.\ -K^E, [Z{p) + HIJT,] , 

Taking the essential supremum of both sides over I, we can deduce from (|4.15p that 

esssup £jZ(r(i^)) J j;] < esssup fJZ(p) + i/^l-Fj < Z{v), a.s., 



(8.55) 



a.s. 



Optimal Stopping for Non-linear Expectations 



50 



which together with (|8.55p proves (|4.22l) . 

Finally, we will prove that r(i^) — Tx(y). For any i £ X and fc G N, (|4.17p . (|4.15p . Proposition 12.71 (3) as well as 



Corollarv 12.31 implv that 

(.) + K.y. = [^(-^- (-)) + Kr,.. M 

> [esssup [Z{t{v)) + |.F.^„^ (.)] + 

> [z{t{u)) + ij;^„^ (,),^(,) I j-.^„^ (.)] + I J-.] 

which together with (|8.54p shows that 

esssup £4-i^y,^„^(,)+i7;^„^(^^|j-,]-£,[r^(^^|j-,] +e.[y^^,^+hi^^^^\f,] 

As fc — >■ c», (|8.53p implies that 

+ I J-.] > f^, [Z(r(:.)) + Hl^^^) I J-.] , a.,s. (8.56) 

The reverse inequality follows easily from (|4.1ip . thus (18. 56^ is in fact an equality. Then the second part of 
Proposition [1?71(1) and (|iT7|) imply that 

Yr(i,) = Z{t{v)) = Z^(^), a.s., 

which shows that inf {i e [v,T] : Z° = Yt} < t{v), a.s. For any 6 G (0,1), since [t e [iy,T] : Z^ = Yt} C {t e 
[v,T] : Yt > 6Z^ + (1 - S){Cy + 2Ch)}, one can deduce that 

T{iy) > inf {t e [i/,T] : Z° = Yt} > inf {t G [iy,T] : Yt > SZ^ + (1 - S){Cy + 2Ch)} AT = ts{v), a.s. 

Letting 6 —?■ 1 yields that 

t{v) > inf h G [i/,T] : Z? ^ Yt] > limTA(iy) = r(i^), a.s., 
which implies that r(i/) = inf {t G [i^,T] : Z^ = Yt}, a.s. □ 

8.4 Proofs of Section [5] 



Proof of Lemma 15. It In light of lNeverJ 19751 Proposition VI- 1-1], it suffices to show that the family {i?'(i/)}i£x 
is directed downwards, i.e., 

for any i,j G I, there exists a fc G I such that R^{v) < R'iy) A W {v), a.s. 
To see this, we define the event |i?'(//) > W{v)} and the stopping times 

P^t^{u)1a + t\v)1a<= ^Si,^T and u{A) = u1a + T1a-= S^^t- 

By Definition 13.21 there exists a. k — k(i, j,v{A)^ G I such that £k = £if^- Similar to ()8.22p it holds for any 
^ G Dom{S) that 

£k[i\F,] = \A£jm:F,] + \A^£,[i\^A, a.s. (8.57) 

Moreover, (|4.5p implies that 

Htp = Hl(^A)Ai',u{A)r\p + Hi{A)Vi^,u(A)yp^^A-Hlr^(^^) + lAHl.^^^y U.S. 
and that -ff^,r'=(i/) =-^^(A)A!v,i/(A)Ar'=(i/)+'^i^(A)Vi/,i^(A)Vr'=(i/) ^ -'-^"'^^.rH'') + -'-'4-^i^,r''(i/)' 
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Using (|8.57p twice and applying Proposition 12.71 (2) to £i and £j, we can deduce from (|5.7p that 
R\iy) > £k [Yp + Ht^p I F,] = 1 ^fj- [Yp + i/,^^^ | J",] + 1 [^p + H^^p \ F,] 



= £j[lAYrj{i, 

= ^A£j[Yri(„ 

> lA£j\Y^k(^ 

— £j\}-AYrk(y 

= lA£j\Y^k^y 



= £k[Y^k(^^-^+H^.^k(^^\T^]= R^{y), a.s., 

which shows t hat R'^M = l ARHi^) + 'i-A'=R'M ^ R' (v) A R^ (v) , a.s. In Hght of the basic properties of the essential 
infimum (e.g., Neveu 19751 Proposition VI-1-1]), we can find a sequence {in}„gN ^ ^'^'^^ that (|5.8p holds. □ 

Proof of Lemma I5.2t As in the proof of Lemma [5.11 it suffices to show that the family {T^{i')}iex is directed 
downwards, i.e.. 



for any i,j G I, there exists a fc G X such that t'^(z^) < T' (i/) A t^{v), a.s. (8.58) 

ifine the stopping time a = t^{v) A {v) £ Si,^t, the event A = > G J> as well as 

the stopping time cr{A) = alA + TIa" G Sa.r- By Definition 13.21 there exists a k — k(^i,j,a{A)) G I such that 

(8.59) 



£^ = £l':^\ Fix t G [0,r], similar to (lO^ . it holds for any ^ G Dom{S) that 



Moreover, we can deduce from (|4.5p that for any p G Sawt,T 

^a\/t,p = Ha(A)A{cr\/t),cr{A)Ap + ^aiA)V{aVt),a(A)yp^■^A''Hl^^p + lAHl^^p, fl.S., 

which together with (|8.59p and Proposition 12. 71 (2) imply that 

^k[Yp+Hl;^f^p\Tcrvt] = ^A£j[Yp+H^y^p\J^„^Jt] + l^^^i [i^p+i?CTVt,p|-^o-vt] 

= £j[1aYp+ lAHi^^JT,^t] +£^[lA^Yp+ lAei/^v^l-^-vt] 
= lA£j[Yp + Hl^^p\T„^yt]+'i-A'=£i[Yp + H'^^^^p\J'„^yt], a.s. 

Then applying Proposition 12. 71 f3). Lemma [331 (2) as well as (|5.6p . we obtain 



R 



fe,0 



= R\aVt)= esssup £k [Yp + H^^^ jT^^t] 

= 1a esssup 8j[Yp-\-Hlyi^p\j='^yt] esssup [Fp + i/^v^pl-^^vt] 



1aR\<J V i) + lA=i?'(fT V i) = lAi?ivt + 1^=^: 



'-trVt' 



a.s. 



Since i?*' , i?-'' and R are all RCLL processes, it holds except on a null set N that 

= ^AR^t + 1ac<^°„ V< g [0, T], 



which further implies that 

T^{v) = inf |t G h T] : = F*} < inf {i G [(t, T] : 



= Yt 



] 



1a inf {t G K T] : i?f ° = ^t} + Ia- inf {i G [a, T] : = Ft} 



(8.60) 
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Since R%(i,) — Yr^ii^): -^t3(i/) ~ '^Tj{i^)i ^-S- and since a — t'^{v) A t^{v), it holds a.s. that Yo- is equal either to i?^ 
or to -R^'*'. Then the definition of the set A shows that — a.s. on A and that R]f' — Y„ a.s. on A^, both of 
which further implies that 

l^inf |< e [CT,r] : = Ftj = ctIa and 1a- inf |i S [cr, T] : = Ff | = ctI^-, a.s. 

Hence, we see from (I8.60p that t^{v) < a = t'^{v) A {v), a.s., proving (|8.58p . Thanks to the basic properties of 
the essential infimum (e.g., Neveu 19751 Proposition VI-1-1]), we can find a sequence {jn}„gpj in I such that 



r(z/) = essinf T*(z/) = lim|T*"(i/), a.s. 



□ 



The limit Iini4-T'"(i') is also a stopping time, thus we have T_{iy) £ S^ t- 

Proof of Theorem I5.lt In light of Lemma [5T2| there exists a sequence {in}„gpj in X such that 

T_{v) — lim4,r-'"(i/), a.s. 

Since the family of processes {Y^}i^x is uniformly- right-continuous" , we can find a subsequence of {jn]n&i (we 
still denote it by {jVijneN) such that 



lim esssup \£i [y^^„ \^t(v)\ - Y^u) I = 0> ^.s. 



(8.61) 



Fix i G I and n G N, we know from Definition 13.21 that there exists a fc„ = k{i, jmliv)) G I such that Ek^ — Efj"^ 
For any t G [0,T], Lemma [5751 implic 
it holds except on a null set N that 



For any t G [0,T], Lemma [5751 implies that = -^T'(i'*)vt' ^"^^ ^i'^'^® n^^fi a,nd i?^"''' are both RCLL processes. 



which together with the fact that t{v) < t'^"(j^) A t^^{v), a.s. implies that 

r'^-iv) = inf {t G [i^,T] : = F^} = inf [t G [T(i.),r] : = Yt] 

= inf {< G [t(i^), T] : i?^"'" = f} = inf {t G [ly, T] : i?^'" = Ft} = r^" (z^), a.s. 
Then g3]), (|57B^ and ([531) show that 



(8.62) 



esssup |fiK,„(,)|-^r(.)] 



a.s. (8.63) 



For any ? G I, Proposition |277|(3), (gJl), (g^l) and dES]) imply that 



H: 



^) - C*|j>(,,)] I + - Cy| + \Ch\ 

C*\Tt{u)\ + {Yt(u) - Cy) - Ch 

l-^z(-)] + "^r{u) - 2a < 2R\t{v)) - 2a, a.s. 



Taking the essential supremum over ^ G I, we can deduce from (|4.8p and (|5.3p that 

a < esssup |f , [y^,„ I - I + < 3i?' {t[v)) - 2a + , a.s.. 
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where 3R'-{t{i^)) ~2C^ + Hl^^^^ e Dom{<g) thanks to PropositionO (1), (SI') and (D2). Applying the Dominated 
Convergence Theorem (Proposition 12.9^ and Proposition 12. 71 {Z). we can deduce from (I8.63P and (|8.61|) that 



V{v) = essinf {v) < lun {v) < Im^S^ [esssup | £i [Y^ (.)| -^r (.) ] - + 



jel n-i-oo ri^oo l ;gj 

Taking the essential infimum of the right-hand-side over i e I yields that 

Viiy) <essM£,[Yrr^)+Hl.ATJ < esssup ( essinf fJi; + iJ^ J J-J ) ^V{v) <V{iy), a.s. 

Hence, we have 



Viu) = essinf f,[y,(,) +Hl,^^,jT^] = Viiy) = essinf ff^^) > Y^, a.s 



where the last inequality is due to ([57 
Proof of Proposition [5T2l By Lemma [5. 2 [ there exists a sequence {«n}neN in ^ such that 

(7 = t{u) = lini J,T*" (i^), a.s. 

n— )-oo 

For any n G N, since a < r'" (z^), a.s., we have 

r*"(i/) = inf{t e [i^,T] : ^ Yt} = mi{t e [<t,T] : = = r*"(cr), a.s. 

Then (|579| and (|5?7| imply that 

= M \^.] - - [F!.-; . , I J-,] - r;- + < esssup f . [yx (,) 1-^.] - 



□ 



Ycr, a.s. 



As n ^ oo, the "(f-uniform-right-continuity" of {Y''}i^x implies that V{a) < Y^, a.s., while the reverse inequality 
is obvious from (15.91). □ 



Proof of Proposition [STSl In light of Lemma [5T1 and (|5.9p . there exists a sequence {jn}neN such that 

V{i^) = V{v) = limlR^'^iv), a.s. 

For any n G N, Definition 13 . 2 1 assures a fc„ = fc(i,j„,i^) e I such that £k^ — £ij^. Applying Proposition 12.71 (5) to 
Si, we can deduce from (13.31) and (15.51) that 



[Vip) + Hi-p I J-,] < f fc„ [W- (p) + Hi-p I T,] = [i?^" (p) + Hl-p I J-,] = [f,„ [E^" (p) + Hi-p \ T,] \ 
= 4 [i?^" (p) + iJ^rJ J".] < i?^" (i^), a.s. 

Then Proposition O (3) and imply that 

essmf gfc \y''{p)\T,\ < 4„ [F*'" (p) | J".] = ffc„ +ffi^:p| -F.] +K < R'^^i^) + -ff^, a.s. 

As n oo, (|5.10p follows: 

essinf I J-J < lim ; i?^" (z/) + iJ^ = V{v)+Hl = l/^^^), a-S- 

fcel n— >oo 

Now we assume that u < p < t_(i>), a.s. Applying Lemma l5.1l and (15. 9p once again, we can find another sequence 
{jnlneN in ^ such that 



V{p) = V{p) = limii?J"(p), a.s. 



Optimal Stopping for Non-linear Expectations 



54 



For any n G N, Definition 13.21 assures a = k{i,j[^,p) E T such that = . Since p < t{i^) < t'''"(z^), a.s., 

using ()5.7p with i — and applying Proposition 12 .71 (5) to , we can deduce from ()4.5p . p.3p as well as Lemma 
Othat 

V\y) = V{v) +Hl^ V{v) + ff5 < i?'^" (i.) + i/^" - 4;, [i?''" (p) + i/p" |-^.] - (p) + i/p" |^.] 

= [fj; [i?*'" (p) + -ffp" I J-p] I J-.] = [i?^" (p) + i/p" I J-.] = £^ [R''" (p) + J-.] , a.s. (8.64) 
Then gH) and jO]) imply that 

C^* < Y; = Yp + Hl< i?^" (p) + Hl< W'^ {p) + i?;, a.s., 

where i?-'i(p) + e Dom{S) thanks to Proposition O (1), (SI') and (D2). As n ^ cx) in (g^, the Dominated 
Convergence Theorem (Proposition 12. 9|) imply that 

V\v) < \mi^£,[W'-ip) + H;\T,] = £,[V{p) + H;\T,] = i,[V%p)\T,], a.s., 
which proves (15. lip . 

It remains to show that {^'(2:(0) A i) }jgjQ is an £i-submartingale: To see this, wefixO<s<<<r and set 

V = r(0) A s, p = r(0) A t. It is clear that v < p < t(0) < t(z^), a.s., hence (|5.1ip . Corollary 12.31 and Proposition 
O (5) show that 

y^(r(0)As) = V\y)<£,[V'{p)\T,] = [l^^ (t(0) A <) | J-^(o)a.] = [5, [y^(r(0) A i) |-^r(o)] 
= £«[r'(r(0) Ai)|-F3], a.s., 

which implies that {V^{t_{Q) A i)}jg[Q j,^ is an fi-submartingale. □ 

Proof of Theorem [HD Proof of (1). 
Step 1: For any p,v E Sq^t, we define 



^Piiy) = es|inf [Yp + Hi,^^ p\Tp^,] + W^^^ e Tp^,. 
It follows from (gT]), (lOl) . and Proposition O (5) that 

CY+2Cjf = essini £,[Cy + Ch\J'pa.] + Ch 

< ^"{ly) < £, [Yp + <A.,p|-^pA.] + < R^'iP A ;^) + H;^,, a.s., (8.65) 

where Aiy)+ H^p^^ G Dom{S) thanks to Proposition O (1), (Si') and (D2). Then Lemma |3^ implies that 

^'^{v) e Dom{S). Applying Proposition 12. 71 (2) & (3) as well as Lemma 15^ we can alternatively rewrite \E"'(z/) as 
follows: 

■^P{v)~Wp^^ = es|inf£',[l{p<^}rpA^ + l{p>,4(i^p + i^^,p) l-T'pAi.] 

= 'is^^^^{^{p<u}Yp^u + '^{p>y}£^\Yp + Hlp\T^'\^^ ls^p<^-}Yp + l{py^,}es&mi£i\Yp+Hlp\T^], a.s. 

Let a e 5o,T. Lemma l373l f2) and Proposition 12.71 f2) once again imply that 

\{y=a}'i!^{v) = l{p<y=„}Yp+\{p^^^^^^essini£,\Yp + Hlp\Tj^ + \{^^„^^H'p^^ 
= l{p<i.=cr}>^p+ l{p>j.}es|inf fi[l{-^^^i,(yp + iJ^p)|j',,] + 
= '^{p<u=a}Yp+ l{p^^}ess\nil{^^^}£i\Yp + HlJ\Ta\ + l{„^„^^Hp^^ 

= l(p<^=,}Fp+l{p>,=,}es|mf^,[rp + i7;Jj-,] = l{,=,}*''(a), a.s. (8.66) 
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Step 2: Fix p £ 5o,t- For any G 5o,t and a e 5iy,T, letting {u,I' ,U) — {p A a, I, {p}) and = Yp in Lemma 

14.21 we can find a sequence {jn}„gpj in I such that 

essinf £^ \Yp + H' „\J^p^.o-] = lim i f j„ \Yp + Hh„ n\J^pAa-] , a.s. 

Definition 13.21 assures the existence of a fc„ = k{i' , jn, p A a) el such that ffc,^ — S^,^"^. Applying Proposition 12.71 
(3) to 8k„ , we can deduce from (|4.5p and ()3.3p that 

(^^) < 4„ [i;, + Hp'a.,p I -^pa.] + = Sk„ [Yp + HX,p I ^pAu] +H'pR.= £k^ [Y^- \ -^pa.] 

For any n G N, Proposition O (3) & (5), (j^S]) as well as (|431) imply that 

C* = ^^j„ oAa] < [^p*^" I oAa] — £j„ [Yp + Hp'}^^ p\!F oAct] + H^p/\a 

< Ij, [Yp + Hl\,^p\Fpr,„] + H;^, < (p A a) + i?;'^,, a.s., 

where R^^ {pAcr)+Hp^^ G Dom{S') thanks to Proposition IS . 11 (1). (SI') and (D2). Then the Dominated Convergence 
Theorem (Proposition [2]9]), Corollary 12.31 and Proposition 12.71 f5) show that 



p/\a 



= [ lini;fj„ \Yp + i?^Aa,p|-7'pAa] + ilUa\^p^'A = £v [essinf + il],„a,p\^ pao\ + lil^„\Tpf,u\ 



= £,.[*''((7)|j-pA.] =fi'[£,'[*''(a)|-Fp]|^.] -fi'[*''((T)|^.], a.s., (8.67) 

which implies that {^'''(i)}te[o,T] is an ^i'-submartingale. Hence, {— ^'''(i)}tiE[o,T] is an f-supermartingale by 
assumption ((5?T2l) . Since satisfies (HO), (HI), (f231) and since Dom{£') G (which results from Dom{S) G 9t 
and dEH])), we know from Theorem [231 that = lim ■^P[q+{t)), t G [0,T] is an RCLL process and that 

n—¥OQ 

pUp'+ = hm -^Piq+it)) for any t G [0,r]) = 1. (8.68) 

step 3: For any u G 5o,t and n G N, q+{u) takes values in a finite set = ([0,T) n {/c2-"}feez) U {T}. Given 
an a G P^, it holds for any m > n that 9^(0:) = a since I?^ C V^. It follows from (|8.68p that 

^P^+ = lim ^P(q+{a)) = «'"(«), a.s. 
Then one can deduce from (I8.66P that 

Q.^D'!^ qG'Z?^ aGiy^ 

Thus the right-continuity of the process ^''^'+ imphes that 

vI'e'+= limM^;;;-^ = limvI/P(g+(^.)), a.s. (8.69) 

We have assumed that esssup£'j[y^ G Dom{S) for some j = j{p) G I. It holds a.s. that 

£j [Y'p \Ft]< esssup [Y^ \Fs\, VteVr. 

sEVt 

Since £j \Y^\J-}^ is an RCLL process, it holds except on a null set N that 

<esssup£;, [y/ |j-,], VtG[0,T], thus [F/ | J" J < esssup [F„^' | J".] , Vn G N. 
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Then one can deduce from (|8.65p . (|4.4I) and Proposition 12.71 f3) that 

< £,[Y= +C' = - Ch +C' < esssupf,[i;^|j-.] - Ch +C', 

where the right hand side belongs to Dom{S) thanks to (D2) and the assumption that Q G Do'm{S). Hence 
the Dominated Convergence Theorem (Proposition 12.91) . (|8.69p . (I8.67P as well as Proposition 12.71 (5) imply that 
= lini ^P{q+{v)) G Dom{S) and that 

< YmvJ,, [^P{qt{y))\:F,] - I, [K'^\:F,] = a.s., (8.70) 

where in the last equality we used the fact that 5'^'+ = lim G Jv, thanks to the right- continuity of the 

n— >oo 

filtration F. 

Step 4: Given u G iSo,t, we set 

7 = t(0)Az/, ln = r{Q) ^q+{ly), Vn G N 
and let p G iS7,t- Since lim t l{r(o)>g+(i^)} ~ -'-{z(o)>i^} ^^"^ since 

{t(0) > C = g+(T(0) A z.)} , {t(0) > g+H} C {q+W) = z(0) A g+l'^)} , Vn G N, 

one can deduce from ([8J0| . (|8J9l) and (|8J6| that 

l{r(o)>.}*''(7) < l{r(o)>.}*^'+ = l{.(o)>.} jim^*''(g+(7)) = Jini^l{r(o)>.}*'' (9,t(z(0) A i/)) 
= „l™,l{^(o)>,}Vl/P(5+(^)) ^ Jim l^^(o)>^+(^)jVl/P(5+(^.)) 

^ Jii^l{r(o)>,+ (.)}*'U(0)Ag+M) =l{.(0)>.}ji^m*''^ a.s. (8.71) 

For any n G N, we see from (|5.9p that 

V'CTn) = Z(7rO = esssup (essinff,[y, + H;^ Jj-^j) >essinff,[ypv7„+i?;„,pv7j-^7j' (8-72) 

Since {t(0) < t^} C {7„ = 7 = z(0)}, Proposition 12. 71 (2) and (3) imply that for any i G I 

^{r(a)<y}£t[Yp + H'-p^^^J\T^J^ = [^{r(Q)<y}{Yp + Hlf^^^p)\T^„] = l{r(0)<i/}^i [^P + ^pA7, p | -^7] ' 

and that 

[ypV7„ +^^7„, pV7„ 7,>] = ^i[-'-{p<7n}^7>.+ l{p>7.>}(-^P+^pA7„,p)|-^ 7.^] 

~ l{p<7„}^7n+-'-{p>7n}'^« [■^P"''-^PA7„, p|-^7n] 

~ -'-{p<7n}-^77i+-'-{p>7.i,z(0)>i'}^i [^P+^pA7„,p|-^pA7„] + 1 {p>7„ ,T(0)<i/}^i [^p + ^pA7, p | •^pA7] ' 

Then it follows from (|8.72p and Lemma 13.31 that 
^(7n) > l{p<7«}^7->+l{p>7ri:T(o)>i/}es|inf £i[Yp + i/p^..,^^p|j>A7„] +l{p>7-^,2:(o)<l^}es|mf £i[Yp + i?p^^_p| J"pA7] 

= l{p<7.i}^7>>+l{p>7»i,z(0)>i'} n) ^pA7„ ) +-'-{p>7„,r(0)<i^} (^''(7) ^ pA-^j i 

As n — > 00, the right-continuity of processes F and , (|8.7ip . Lemma [531 as well as Proposition 12.71 (2) & (3) 
show that 



lim F(7„) > 1 

{p=7}^ ^ "'"{P>7.Z(0)>'^} 

hm vl/P(7„)_i/;^J -1-1 

{p>7,r(0)<i/} *''(7)-i/;A7 

n— >c» \n— >-oo / \ / 

> l{p=7}^7 + l{p>7}(*''(7) -■f^p'A7) = 1{P=7}^7 + l{p>7}es|inf [Fp +Hl^^J\Tp^^] 
= es|inf (l{p^^}r7 -I- l{py^}£^[Yp + H\ p\T^]^ = es|inf [l{p=^}y7 + l{p>7}(Fp -I- ^^;,p)|-7>] 
= essinf £i [Yp + -ff7,p [^7] , as. 
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Taking the essential supremum of the right- hand- side over p G t^-y.T'i 

we obtain 

lim V{jn) > esssup (essinf fi[yp + W J J^-y]) = Vi^i) = V{-i), a.s. (8.73) 

On the other hand, for any i E I and n e N we have that V{jn) = Viln) — essinf i?'(7„) < R^ijn), a.s. Then 
()5.6p and the right continuity of the process imply that 

IS ■l/(7„) < lim (7„) = lim i?;^^ = IVf = i?^(7), a.s. 

Taking the essential infimum of -R*(7) over i El yields that 

Im V"(7„) < essinf (7) = F(7) = 1^(7), a.s. 

This inequality together with (18.731) shows that Um T^(7n) — ^(7)1 a.s., which further imphes that for any v G tSo,T 

n— >oo 

and z G X 

JimV-^(r(0)Ag+M) = Jim(y(r(0)Ag+(.))+i/^(„^^^,(^^) 

- ^(r(0)Ai.)+i7^(„)^, = r'(r(0)A^.), a.s. (8.74) 

Step 5: Proposition 15.31 shows that the stopped process (z(0) ^^)}fg[oT] fi'-submartingale, thus { — 

F*'(t(0) At)}^g,py, is an f'-supermartingale by ([ET^ . Then Theorem O hxiplies that V^/'+ = lim T^''(t(0) A 
(7+(i)), t e [0,r] is an ROLL process and that 

p('t//'+ = lim F*' (t(0) a q+{t)) for any t G [0, T]) = 1. 

For any ct, C G iSo,t, Lemma [3731 and ()5.4p show that 



l{a=i}V{cT) = essinf (a)) = essinf (l{,^^}i?^"(C))=l{,=c}^(C) =l{.=c}nC), a.s., 

which imphes that 

1{.=C}^''('^) = 1{.=C}^(^) + l{^=C}^f5 = 1{^=C}^(C) + l{.=C}^c' = 1{.=C}^'''(C), (8.75) 

Let a e '^(fj' take values in a finite set {ti < • • • < tm}. For any a G {1 • • •™} and n G N, since {cr = ^q} C 
{t(0) a (?,t(o-) = t(0) a q+(ia)}, one can deduce from (|8.75p that 

l{.=t„}^^' (r(0) A g+(a)) = (r(0) A q+{U)) , a.s. 

As n — >■ (|8.74p shows that 

l{a=t^}V:'^+ = = lim li^^t^yV (r(0) A g+(t„)) = lim (t(0) A g+(a)) 

= l{<,=t„}y^'(T(0)Aa), a.s. 

Summing the above expression over a, we obtain = V^' (z(0) /^cr); a-s. Then the right-continuity of the 

process and (|8.74p imply that 

= hm Vi:+ = lim T/^' (t(0) A g+(z.)) = V^' (t(0) A z.) , a.s. (8.76) 

In particular, '"^ is an RCLL modification of the stopped process \ V (t(0) Ai) ^ . Therefore, 

L J te[o,T] 

yo ^ ■+ _ iJ^^i^j^^l ^ ^ is an RCLL modification of the stopped value process {V^(t(0) A i)}fg[o r]' 
v e 5o,T, (|8.76p implies that 

K° = - i/^'(o)A. = fc(0) At.) - = T/(t(0) a i/) , a.s., proving ([EISl). 
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Proof of (2). (|5.13p and Proposition 15.21 imply that K^^q) ~ ^(x(0)) = ^t(o); s-S- Hence, we can deduce from the 
right-continuity of processes V° and Y that Ty in (|5.14p is a stopping time belonging to 5o_r(o) and that 

Yr^ - - V{tv), a.s., 

where the second equality is due to (|5.13l) . Then it follows from (15.111) that for any i e I 

T^(o) - v\o) < £^[v\rv)] = £^[y:^] = £.[i;v]- 

Taking the infimum of the right-hand-side over i G I yields that 

V{0) < inff.[y;j < sup (infS^F;]) =ViO) = V{0), 

which implies that iniSi [YI! 1 = sup iniSi \YJ;] . □ 
8.5 Proofs of Section |6] 

Proof of Proposition [67H Fix t e [0,r]. For any ^ e Dom{S) and i G I, the definition of Dom{<S) assures that 
there exists a c(^) G K such that c{£) < a.s. Then Proposition 12. 71 (5) shows that 



40 = S.HOlJ^t] < £^[^\J^t], a.s. (8.77) 

Taking the essential infimum of the right-hand-side over j G X, we obtain for an arbitrary i' G I that 

c{0<mJ't]<£A^\J't]: a.s. 

Since fi/[^|J"t] G Dom*{£ii) = Dom{S), Lemma [5^ implies that ^[C|^t] G Dom{S), thus ^[-[^t] is a mapping 
from Dom{S) to Domt{S) = Dom{S) n L°(J"()- 

A simple application of Lemma [5751 shows that ^ satisfies (A3), (A4) and (|6.ip . Hence, it only remains to show 
(A2) for S_. Fix < s < t < r. Letting {v,T ,U) = (^,1, {?"}) and taking X{T) = C in Lemma 14721 we can find a 
sequence {injneN in I such that 

^[ei-Ft] =essinffiKI-^t] = limi^KI-^t], a-S- (8-78) 



Now fix i G X. For any n G N, it follows from Definition 13.21 that there exists a fc„ = k{j,in,t) G I such that 
£k„ = • Applying p.3p yields that 

For any n G N, we see from (|8777|) and ([8778]) that 

c(0 = ^»„[c(e)|^d < 4 [C| J-*] < f^,, [^\Tt] , a.s., 

where [^|7^f] G Dom^{£i^) — Dom{S). The Dominated Convergence Theorem (Proposition 12. 9p and (|8.79p 
then imply that 

Sj[mH\^s] = hm > m^sl a.s. 

Taking the essential infimum of the left-hand-side over j G X, we obtain 

^[S[i\Ft]\H > i.[^\^sl a.s. (8.80) 
On the other hand, for any i £ I and p G St.Ti applying Corollarv l2.3[ we obtain 

Taking the essential infimum of the left-hand-side over i <E I yields that ^[^|J^s] > ^[^[■^l-^t] |-^s] , a.s., which 
together with ([5:M| proves (A2) for S_. □ 
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8.6 Proofs of Section [7] 

Proof of Proposition [I3J By ([72]), it holds dt x dP-a.s. that for any z €R'' 

\9{t,z)\ ^ \g{t,z) - g{t,0)\ < Kg\z\, thus g{t, z) = -Kg\z\ < g{t, z). 

Clearly, g is a generator satisfying (j7.2l) . It is also positively homogeneous in z, i.e. 

g{t,az) = -Kg\az\ = -aKg\z\=ag{t,z), Va > 0, Vz G M''. 

Then Example 10 of Peng 1997 1 (or Proposition 8 of Rosazza Gianin 200d |) and (17.61) imply that for any n G N 
and any A € Tt with P{A) > 

n£g[lA] = £g[nlA] < £g[nlA]. (8.81) 
Since > (which follows from the second part of (Al) ), letting n -> cx) in ()8.81|) yields (HO). 

Next, we consider a sequence {CnjneN C L'^{Ft) with sup|^„| G L?{Ft)- If converges a.s., it is clear that 

neN 

^ = lim ^„ e L^(J-'t). Applying Lemma |7. II with fi — Kg, we obtain 

n— >oo 

\SaiCn] ~ SM < [\£,n - CI] = \\£g, " CI] 

where we used the fact that Kg^ = /x in the last inequality. As n — > oo, thanks to the Dominated Convergence 
Theorem of the linear expectation i?, we have that — ^11? arx- \ = -£'ICn — ~^ 0; thus lim £„[^„] = f„[^]. Then 
(HI) and (H2) follow. 

For any v e 5o,T and £, e L'^'+{J't) = G ^^(-7^^) : C > 0, a.s.}, LemmaO(l) shows that sup |fgKI-^t]| £ 

te[o,T] 

L^'+(Jt), consequently J'jy] G L'^'^{Tt)- Since X? ^ J".] is a continuous process, X^'^ = = G 
i2'+(J"T), which proves (H3). □ 

Proof of Proposition F7T2t Fix v G Sq.t- It is easy to check that the generator g^ satisfies (|7.2p with Lipschitz 
coefficient Ki V ■ For any ^ G L^{J-t), we set 77 = F^^^^ G J-l/ and define 



< II sup £g^[\^n~^\ \Tt] 
L^(^t) t£[0,T] 



e. ^ 1 



{.<t}ef«^ + i{,>t}er\ v<G [o,r]. 



It follows that 

g-'it, Qt) - l{.<t} 52(i, e*) + l{,yt}gi{t, Qt) = !{.<*} g2(i, ^^) + l{,>t}5i(t, e?'«^), Vi G [0, T]. 
For any t G [0, T], since {i' < t} G -Ft, one can deduce that 



The continuity of processes g'^{s,Qs)ds, J^QsdBg and F^'^^ then implies that except on a null set N 

i{u<t} (^^ + ^ g^is, e,)rfs - ^ e,dB, j = i{,<t| Tf'0\ yt g [o, t]. 



(8.82) 
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Taking t — v{u)) for any uj £ N'^ yields that 



^+ / g''{s,e,)ds- f e,dB,^ri-3- ^Tj, a.s. (8.83) 

J 1/ J v 

Now fix t e [0,r]. We can deduce from that 

= l^^>t}{rj + J\i{s,Qy^)ds- J^^ &i^3idBs), a.s. (8.84) 

Moreover, Proposition 12. 71 (5) implies that 

Sg^ivlJ'tAu] ^ V+ f 9i{s,ey')ds~ [ Qy'dB,=£gM^A+ I 9i{s,Qy')ds- j Q^'dBs 

J tAv J tAv J tAu J tAu 

= 77+/ gi{s,Qy)ds- Q^dBs, a.s. 

Jthu Jt/\v 

Multiplying both sides with l{i/>t} and using (|8.84p . we obtain 



t\, a.s., 



which in conjunction with (|8.82p shows that for any t £ [0, T] 

Since g'^{s,Qs)ds, QgdBs and Sg^^^g^i^lJ^-] are all continuous processes, it holds except a null N' that 
^9uJ^\^t]=^ + g^s,e,)ds- QsdBs, VtG[0,r]. 

One can easily show that {£g,,g., Kl-^], ©) e C|([0, T]) x H|([G, T]; M'^). Thus the pair is the unique solution to the 
BSDE(e, g"), namely £g. [^\Tt] = Kl-F*] for any t e [0, T]. □ 

Proof of Theorem I7.lt We first note that for any g G (|7.7p implies that for every fg-submartingale X, — X 
is an £'g--supermartingale although g^ is concave (which means that £g- may not belong to S"). Hence, condition 
(|5.12p is satisfied. 

Fix g 6 Clearly Hq — 0. For any s, i 6 2?t with s < i, we can deduce from (hi) and (/i2) that 



Cj^,=c'T<l c'ds<l hadr = Hlt< I h'{r)dr< / h'{r)dr, a.s., (8.85) 



which implies that 



CjsT' < essinf iJf j < esssup i/f ^ < / h'{r)dr, a.s. 

s,t£VT\s<t ' s,te-DT;s<t ' Jo 

thus (S2) holds. Since h'{r)dr e L'^(Tt), it follows that 



esssup Hit G L^'*{Ft) = e ^^(-7^^) : ^ > c, a.s. for some c G M} = Dom{<^') 

s,tG'DT;s<t 
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We can also deduce from (|8.85p that except on a null set N 

C^' < H^t < [ h'{r)dr, V < s <t <T. 
Jo 

Hence, for any v, p & Sq^t with v < p, a.s., we have 

C^' <mp< I h'{r)dr, a.s., 
Jo 

which implies that iJ^^ e L^^*{Tt) = Dom{S"); so we got (SI'). Moreover, (S3) directly follows from (h'S). 

Next, we check that the process Y satisfies (Yl) and (|4.6p . By (|7.1ip and (Y3), it holds a.s. that Cy < i^t < Cf 
for any t G "Dt- The right-continuity of the process Y then implies that except on a null set N 



Cy <Yt< Cy, e [0, T], thus Cy<Yp< Cy, Vp e So,T- 



(8.86) 



Since Cy e L'^{Tt), it follows that Fp G L'^^*{Tt) = Dom{S") for any p e 5o,t, thus (Yl) holds. Moreover, for 
any g e"^', p e 5o,t and t gVt, Proposition [2]2] (2), ((8^ and Lemma [7J] (2) show that 



Cy + c'T = £<,[Cy + c'T\Tt] < Sg 











r c'ds 






Jo 





i-T 



Y„ 



m\ds 



< sup £g 

t&[0,T] 



CyV(-Cy)+ / /l'(s) V (-c')ds 

Jo 

Taking essential supremum of £g\Y^\Tt\ over {g,p,t) G x 5o,t x I?t, we can deduce from (A4) that 



Cy + c'T< esssup Sg\Y^\Ft]< swp £, 



(g,p,t)e»'x5o,TXl5T 

Lemma FTT] fl) implies that 



tG[0,T] 



Cy + / /l'(s)ds 



- Cy - c'T, a.s. 



..87) 



sup Eg 

te[o,T] 



Cy+ / /l'(s)ds 



Cy+ / /l'(s)ds 



< CX). 



Hence, we see from (|8.87p that esssup £g[Y^\J^t] G L'^''^{J-t) — Dom{S'), which is exactly 



(g,p,t)e»''x5o,TXl7r 



Now we show that the family of processes {Y^ , t £ [0'^]}ggc^' both "<l"-uniformly-left-continuous" and 
"#'-umformly-right-continuous" . For any v, p G So,t with v < p, a.s., let {pn}„gN C <S,y,T be a sequence increasing 
a.s. to p. For any g G Lemma [77T] (2) implies that 



^9[l^Yp,^+Hl\T,,] -Eg[Y^\F,] 



< S„ 



" Y _ Y 



_n_Y - Y 



h3{s)ds 



h'{s)ds 



a.s., 



where g,^,{z) = M|z|, z G M'' and h'{t) = h'{t) — c' , t £ [0,T]. Taking essential supremum of the left hand side over 



g G'^' yields that 



esssup 



- Y 

.l_l^p„ ^p 



h'{s)ds 
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Moreover, Lemma mi fl) implies that 



< 



-2— y — Y 



sup £g^, 

te[o,T] 
p _ 
h'{s)ds 

Pri 



" Y —Y 



h'{s)ds 



(8.89) 



Since 



I n-l'- P' 



Y„^~Y„\ < 



ri-1 rp 



h'{s)ds ^ converges to in L^{!Ft), 



the continuity of Y implies that lim (^iTTrr^pn ~ + Jp h'{s)dsj — 0, a.s. It also holds for any n>2 that 
\-J^Yp^~Yp\+ [''h'{s)ds<3{C{.-CY)+ [ h'{s)ds~c'T, a.s., 

J Pn Jo 

where the right-hand sides belongs to L'^{Tt)- Thus the Dominated Convergence Theorem implies that 

the sequence | '^^^Pn ~^ j ^ 

which together with and implies that 

the sequence \ esssup \£g \-^Yp^ + ~ \Xp\-^A I i ^^^^ converges to in L'^{Ft)- 

Then we can find a subsequence {nk}k&i of N such that 

lim esssup I f ^ [^F^ + m - Eg [F/ 1 J",] | = 0, a.s. 

Therefore, the family of process {F^j^g^' is "(^''-uniformly-left-continuous" . The "<^'-uniform-right-continuity" of 
{Y^}g^cffi can be shown similarly. □ 

Proof of TheoremlHl} For any U e ii, TheoremOand Proposition|12]imply that Z^^° ^ [z'j^ + /q h^ds\ 



I |_ ' te[D,T] 

is an £g -superr nartingale. In light of the Doob-Meyer Decomposition of ^-expectation (see e.g. IPena 19991 



Theorem 3.3], or iPena 2004 , Theorem 3.9]), there exists an RCLL increasing process A*^ null at and a process 
e H|([0,T];R'') such that 



z^'° = + l\u{s, )ds + - Af - ds., t e [o,r] . 



(8.90) 



In what follows we will show that 

u* {t, uj) = u* {t, uj, ef i^)) , {t, uj)e[o,T]xn 

is an optimal control desired, where f/° = denotes the null control. 

Recah that t(0) = inf G [0,r] \ ^ Yt}. Taking t = r(0) and t = t(0) A t respectively in ([OO]) and 
subtracting the former from the latter yields that 



yU,0 _ yU.O 

r(0)At — ^-(0) 



/ gjs, e]!)ds + A^(„) - A^(o)^, - / el'dBs, t e [0, r 

Jt(0)M Jt(0)M 



(8.91) 



which is equivalent to 

z%^^^ = 4(0) + / H{s, e,^, u^s + A^(o) - A^(o)^, - / ds,, t e [o,r] . (8.92) 

JT(0)At J-(0)At 
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In particular, taking U = U'^, we obtain 

r(0) 
r(0)At 



r~iO) r~{0) 

Z^io)At = Z^io) + / His, eT,U^)ds + - A^^)^, - / efdBs, t e [0, T] 



Comparing the martingale parts of (|8.92p and (|8.93p . we see that for any C/ G il, 

e^^QY\ dtxdP-a..s. 



(8.93) 



(8.94) 



on the stochastic interval |0,t(0)1 = {(<, e [0,T] x r2 : <t < r(0)}. Plugging this back into (|8J2|) yields that 



(0) 

T(0)At 



i7(s,e,^ ,[/,)ds + A^(o)-A^(o)At 



^(0) 



(0)At 



ds„ te[o,r]. 



(8.95) 



A 



Let us define (z) = Kq 



A 



any U G il, we set Ft — £, 



z|, z E K*^. Note that it is not necessary that 17^ = gu for some U € ii.. For 
^ " ' , t e [0,r], which are the solutions to the 



,7(7,0 

^-(0) 



and r* = f o 



BSDE(Z^o° and BSDE( - Af^^^,g^J respectively, i.e. 



r(0) 



XoleJds- / e^dBs, t e [o,r] 



where 6,6 e "HKiO, T]; R'^). Applying Proposition O (5) and Corollary EJl we obtain that for any t e [0,T] 



rr(0) - r-(o)At — ^^g^ 



z. 



U.O 
r(0) 



^ 7-1 



yU,a _ c 
r(0) 



-(0) 

r(0) 



Then the continuity of processes P. and Z.''^'*^ imply that 



7(7,0 
"r(0) 



J- f I 



■(0)At 



= Z. 



r(0) ^fc/ 



7(7.0 

'r(O) 



-(0) 



^-(o)-rt, as- 



^ * ~ ''r(0)At - ^t{0) ^ '^T{ia)/\t + ^ r(0)A« ^ "(O) - ^r(O) ^ '^r(0)At 



,(7,0 ,7C/,0 



r(0) 



r(0)At 



3^(3,65)^5 - 



r(0) 



6,,rfB, 



r(0)Ai 



^r(O) ~ ^r(0)At 



/•~(o) /--(o) 
/ H{s,Qs,Us)ds~ / 6,dB^ 



\U' , A (7* 
"^t(O) + ^r(0)Ai 



r(0)At 

.-(0) 



(0)At 



i7(s,6„[/,)-i?(s,6^ ,[/;) ds- / (6,-6n'^S., ie[0,r], 

(0)At 



^(0) 



where we used (|8.95p with U ~ U* in the last inequality. Since it holds dt x dP-a.s. that 

Hit, Qt, Ut) - Hit, ef,u:) = Hit, 6*, Ut) - H{t, ef,u*it, ef )) < Hit, Qt, Ut) - Hit, ,Ut) 



g"it, et,Ut)- g"it, qT ,Ut)<\g°it,Qt,Ut)- g"it, 6^' , C/t)| < i^olet - 6r I , 



the comparison Theorem for BSDEs (see e.g. iPena 19971 Theorem 35.3]) implies that 



r* > P* - z,%V* - 



u* 



■(O)At' 



te[0,T]. 



In particular, when i = 0, we can deduce from (|4.17p that 



MO) 



> 



£9, [^^(r(0))]-^(0). 



Taking supremum of the right hand side over U £ ii and applying Theorem 14. 1 1 with ly — 0, we obtain 



0>£„ 



r(0) 



> supf [Z^(r(0))] -Z(0)=0, 
(7eii 



Optimal Stopping for Non-linear Expectations 



64 



thus £„ 



= 0. The strict monotonicity of g-expectation (see e.g. ICoauet et al.l 20021 Proposition 



2.2(iii)]) then implies that ^^{0) ~ 0, a.s. Plugging it back to (|8.9ip and using (|8.94p . we obtain 



T(0)At 



which implies that 



r(0) 



(0)At 
T 



r(0) 



(0)At 



5„.(s,l{,<-(0)}ef )ds-y^ l{s<-(o)}0f dS., <G[0,r] 



5.96) 



vU', 



<(ow' vte[o,r], 



namely, |z^jq^'^j| is a 5^, -martingale. Eventually, letting i = in (|8.96p . we can deduce from (I4.17P and 

Theorem O that 



Z(0) = = 



r(0) 



Z(r(0)) 



10) 



hH'ds 



(0) 



10) 



Proof of Proposition [7731 Because of its linearity in z, the primary generator 



g°{t,uj,z,u) ^ {a-\t,X{Lu))f{t,X{uj),u),z) y{t,uj,z,u) G [0,T] x 1] x R'^ x 5 



□ 



(8.97) 



satisfies (g°2) and (g°4). Then (g°l) follows from the continuity of the process {-'^(i)}tg[o,T] as well as the measur- 
ability of the volatility a and of the function /. Moreover, (I7.15P and (|7.2ip imply that for a.e. t € [0,T] 

|g°(t,^,zi,u)-5°(t,L.,Z2,«)| - \{a-\t,X{u;))f{t,X{u;),u),z-z')\ < \\a-\t,X{Lj))\\ ■ \f{t,X{Lj),u)\ ■ \z-z'\ 

<K^\z~z'\, Vzi,Z2 e K'', V(w,u) e r2 X 5, 

which shows that g° satisfies (5°4) with Ko = K^. Clearly, it = 7ip{[Q,T]; S) is closed under the pasting in the 
sense of (|7.13l) . Hence, we know from last section that {£g^}u^li is a stable class of g-expectations, where is 
defined in ^A^. 

Fix [/ e it. For any ^ e L^iJ^), we see from (fTi)) that 

= e + ^ {<j-\s,X)f{s,X,Us),es)ds- esdBs=^~J^ QsdB^, te[0,T], 



where B^ = Bt- /J a-^{s, X)f{s, X, Us) ds, t £ [0, T] is a Brownian Motion with respect to Pjj- For any t e [0, T], 
taking i?[/[-|J^f] on both sides above yields that 



^Eu\^\Tt\, a.s. 



(8.98) 



Hence the (/-expectation £g coincides with the linear expectation Eu on L'^{Tt) 



Clearly, the process Y = {(^(^(t))}^^^^ satisfies (F3) since 1^ is bounded from below by —K. We see from 
([7:20)) that for any t £ [0, T] 

i^t-¥'(^(i))<i^|^(01<^ll^llT- 
Taking essential supremum of Yt over t e 2?^ yields that 

Cy = fcsssupyt)^ < i^ll^ll^,, a.s. (8.99) 
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For any t S [0,T], the Burkholder-Davis-Gundy inequality, (crl), (|7.15p as well as Fubini Theorem imply that 



E 




= E 


sup |X(s)p 


< 2x^ + 2e\ sup 


/ a{r,X)dBr 


^1 < 2x^ + 2CE J 










Ue[o,t] 


Jq 





< 2x^+4(7 / \a{s,d)\^ds + 4CE \a{s, X) - a{s,d)\^ds 



< 2x^ + AC \a{s,Q)Yds + ACn^K^ E 



\X\ 



ds. 



Then applying Gronwall's inequality yields that 



E 



{\\X\\*j) <[2x^ + AC |CT(s,0)pds e 



ACn^K^T 



< OO, 



(8.100) 



which together with (IKM)) shows that Cy e L'^{Tt)-, proving (mT]) . 



Next, we define a function h°{t, uj, u) = h(t, X{uj), u), V {t, uj, u) £ [0,T] x ft x S. The continuity of the process 
{X(t)}tg[o.T] and the measurability of the function h imply that h° is ^ ^ (5/^(R)-measurable. We see from 
(fr2T|) that h° satisfies (hi). It also follows from (L2TI that for a.e. t G [0,T] and for any w e il, 

hf{u) = h''{t,uj,Ut{uj)) = h{t,X{u),Ut{io)) < K\\X{uj)\\*j,, VC/ Git. 

Taking essential supremum of (uj) over [/ G il with respect to the product measure space ([0, T] x f2, A x P) 
yields that 

h{t,uj) = (esssup/if (w))^ < ii:||X(cj)||5., dt X dP-a.s., 

which leads to that h{t,Lu)dt < KT\\X{lu)\\^ , a.s. Hence, (|8.100p implies that h{t,uj)dt G L'^{Tt), proving 
{h2) for h". 

Wc can apply the optimal stopping theory developed in Section |3] to the triple {^^}(7gji, ^) and 

use (|8.98l) to obtain (|7.17p . In addition, if there exists a measurable mapping u * : [0,T] X rj X R'' 5" satisfying 
(fTTSl) . then (|8J7)) indicates that for any {t,uj,z) e [0,T] x n x R'* 



sup( UJ, z, u) + h"{t, uj,u)] = sup H{t, X{uj), z, u) = H{t, X{uj), z, u*{t, X{uj), z)) 



ues 



g°{t, w, z, u*{t, X{uj), z)) + h^it, oj, u*{t, X{uj), z)), 



which shows that (|7.14l) holds for the mapping u* {t,uj , z) = u* [t , X {uj) , z) , {t,Lu,z ) £ [0,T] X n xM.'^. Therefore, 
an application of Theorem 17.21 yields (|7.19l) for some C/* G il. □ 



Proof of Proposition rmi (fTM)) directly follows from iBriand and Hul |2008l Theorem 5]. To see ([7^ . we set 

AF = r«i'9 - T^^-s and AO = B^^'S - Q^'^ s, then fTT^ m implies that 

dATt = -{g{t,el"')-g{t,ef''))dt + AetdBt^- J ^{t, XASt + qI"' )AetdXdt + A&tdBt 
= AOti^atdt + dBt), te[0,T], 

where at = |f (AAOt + ef'^)d\, t G [0,r]. Since AfF([0, T]; R'') C M|([0,T];R' 
deduce from ([772^ (n) that 



H|([0,r];R'^), one can 



E 



latfdt < E 



T /.I 



dg 



< 2k^t + -k^e f (|e^'^|' + lef'^^l 

3 Jo ^ 



dX dt < 2k^T + 2k^E 
dt < OO. 



T nl 



|Ae^'^ + (i-A)e«='^|2(iAdt 
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Moreover, Doob's inequality shows that 









i 








i 




E 


sup 


/ a^dBs 




< AE 




/ CLsdBs 




= 4:E f \at\'^dt < oo 




-«6[0,T] 


JQ 








Jo 




Jo 



(8.101) 



Thus, we can define process Qt ^ cxp | — 5 /q jospds + UsdBs^, t e [0, T] as well as stopping times 

j/„ = inf {t e [iy,T] : Qt V |Art| > n} A T, Vn G N. 
It is clear that lim fi^n — T, a.s., and (|8.101l) assures that there exists a null set A'' such that for any uj G N'^, 

n— J-oo 

T = Vrni^) for some m — m{uj) G N. 

For any n G N, integrating by parts on [v^ Un] yields that 



Q^^AT^^^ Q^AT^ - QtA&tatdt+ QtAOtdBt + AVtQtatdBt+j QtA&tatdt 

J u J u J u 

\QtAQt + ATtQtat)dBt. 

which implies that E\Qy^ATi,^'\ — 0. Thus we can find a null set Nn such that 

Ar,„(„)(w)=0, Vc^gTV^. 

Eventually, for any w G liV U ( U Nn) \ , we have 

L ^ neN ' J 



= V^^^Huj) = lim r'^^f Auj) = lim T'^^f ^('^) = r^''^(t^) = ^^(w) 



□ 



Proof of Proposition 17. 5t Let {A„}„gN be any sequence in Tt such that lim s|,1a„ = 0, a.s. For any 



A 



?7 G U-+{Tt) = e ^''(^t) : C > 0, a.s.}, since 



,Aie+iA„»)i 



< E 



-£[6"^'*'] < cx) and since supi? 
holds for each A > 0, Lemma [7.21 implies that 



<\e{^^\^\\^\e{^'^\^\\<oo 



= lim 



sup 

.te[o,T] 



> lim |fg[e + Uj/]-f§[e]| >0, 



thus Eg satisfies (H2). Similarly, we can show that (HI) also holds for Eg. 

Moreover, for any v G 5o.t and ^ G 1?'^{Tt)-, since the process F^^^ belongs to Cp([0,T]), one can deduce that 
^g[i\^A = r^'§ G U-+{Ft). Then the continuity of the process X« = implies that = X^, = Eg[i\Fy] G 

L'='+(J't), which proves (H3). □ 

Proof of Theorem 17.31 This Proposition is just an application of the optimal stopping theory developed in 
Section|4]to the singleton {Eg}. Hence, it suffices to check that Y satisfies (Yl), (Y2) and (|4.2ip . 

Similar to (j8.86p . it holds except on a null set N that 



Cy <Yt< Cy, yt G [0, T], thus Cy <Yp< (y, Vp G So,t- 
Since (y G L'^{^t), it holds for any p G 5o.t that 



£;[e^l^''l] <E 



£;[e^'^^] < CX), VA > 0, 



(8.102) 



(8.103) 
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which imphes that Yp G Z?'#(J^t) = -Dom({fg}). Hence (Yl) holds. 

Next, for any p G 5o,t and t G Pt, Proposition [2?2] (2), (|8.102p show that 



Cy = £g[Cy|J-t] < £g[Yp\Tt] < SgiCrl^t] = T^^^^ < sup |r: 

te[o,T] 

Taking essential supremum of £g[yp|j^j] over {p,t) G Sq,t x yields that 

Cy < esssup £g[yp|j^t] < sup [Fj 



(p,t)e5o,TXl?T 



te[o,T] 



<Y;g I 
t 



bmce r^'-'S G C|([0,T]), or equivalently sup IFj^'^I G LP{J't)j can deduce that esssup £g[y^|j^t] G 

te[0,T] (p,t)G5o,TXX'T 

LP'^iTx) = i:'om({£:g}), which together with Remark 1121 (2) proves (Y2). 

Moreover, for any i^, p G iSq.t with v < p, a.s. and any sequence {pn}„gN C 5,y_T increasing a.s. to p, the 
continuity of the process Y implies that -^^hyYp^ converges to Yp a.s. By (|8.102p . one can deduce that 



supi? 

new 





< supi? 




< E 


g2A(cV-Cy)' 






< oo, VA > 0, 

















exp{A|;^rp„|} 
which together with (18.103^ allows us to apply Lemma 17.21 



= lim 



sup 

.tG[0,T] 



£g[^YpjTt]~£g[Yp\Tt] 



> lim E 



£g[^,YpjF,]~£g[Yp\J-,] 



>0, 



thus lim E 



£g[^YpjT,]-£g[Yp\T,] 



0. Then we can find a subsequence {jT-feljtGN of N such that 



proving (|4.21l) for Y. 



□ 
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